Home > Jobs > Audio & Speech > Music Producer & Audio Post Specialist (AI Evaluation)
✓ Verified Audio & Speech 🔥 High Volume

Music Producer & Audio Post Specialist (AI Evaluation)

Compensation $70 - $120 / hr
Location United States
TIER 2/5 High Volume • Fast-Track
High Acceptance Rate
Interview Format 15-min Async / AI Screen
Insider Preparation Tip Ensure clear microphone audio and highlight direct language or evaluation experience for instant fast-tracking.
SPONSORED (728x90) Accelerate your AI benchmarks: Explore verified developer tooling & APIs

Role Description & Scope

Executive Role Brief & Overview

A leading frontier AI research initiative is onboarding vetted domain specialists for this remote role. Specialists are compensated at $70–$120/hr via direct weekly or bi-weekly settlements for all verified task submissions. Success in this Music Producer & Audio Post Specialist (AI Evaluation) capacity requires deep Audio / Speech-to-Speech Evaluation to adjudicate ambiguous model completions and refine training datasets. Designed for independent professionals, this engagement offers fully self-paced scheduling with no mandatory daily standups. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.

  • Primary Competency: Audio / Speech-to-Speech Evaluation
  • Credential Tier: Senior
  • Candidate Profile: Ideal for Senior voice professionals, acoustic annotators, and speech evaluators focused on prosody, clarity, and transcription fidelity.
  • Verified Compensation: $70 - $120 / hr

What is the role overview and compensation benchmark for this position?

  • Role Scope & Domain: Verified remote contract for Music Producer & Audio Post Specialist (AI Evaluation) within the Audio & Speech track on verified partner platforms.
  • Direct Compensation: Rates range from $70 to $120 per hour (category benchmark average: $52/hr) with direct escrow disbursements.
  • Work Structure: Fully remote, flexible scheduling with independent task execution.

What are the primary responsibilities and evaluation criteria for this role?

  • Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
  • Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
  • Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.

Detailed Role Specifications & Project Scope

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced generative AI models.

# 1\. Overview

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking a talented Music Producer and Audio Post Specialist, a commercial composer and mixer, with deep, hands-on experience scoring, mixing and mastering spots for broadcast and digital, to bring real music and audio post judgment and elevate the quality of our AI training data. This is a full-time commitment of 40 hours per week.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

# 2\. Key Responsibilities

  • Guide research teams to close knowledge gaps and improve AI model performance in commercial music production and audio post-production.
  • Design challenging, real-world music and audio tasks, such as scoring to picture, multi-stem arrangement, voice-over cleanup, sound design and mixing for ads, and produce rights-cleared reference deliverables in editable session formats.
  • Evaluate AI-generated music, voice-over, sound design and mixes and give clear, written feedback, catching problems with structure, sync to picture, intelligibility, mix balance and loudness.
  • Develop guidelines, rubrics and quality checks for music and audio, including technical loudness and sync checks.
  • Collaborate with other subject matter experts to ensure consistency and accuracy in training data.

# 3\. Core Qualifications

  • 5+ years of shipped commercial music or audio post work for agencies, brands, broadcasters or production companies, at a music house, audio post studio, production music library, network or in-house brand audio team. Crowd rating, data labeling and student work do not count.
  • Composer and producer credits on broadcast or digital spots, with multi-stem arrangement, alt mixes and cutdowns (:60, :30, :15, :06) delivered to picture.
  • Mix and master credits on spots delivered to broadcast loudness specs such as ATSC A/85 (-24 LKFS, -2 dBTP) and EBU R128 (-23 LUFS, -1 dBTP), with the ability to explain the specs from memory.
  • Professional fluency in Pro Tools, Logic Pro or Reaper, plus iZotope RX for voice-over and dialogue cleanup and a loudness meter such as iZotope Insight, Nugen VisLM or Waves WLM. Dolby Atmos or 5.1 delivery is a plus.
  • Fluency with editable source files and deliverables: DAW sessions, DME and instrument stems, cue sheets, ISRC and metadata, sync licence terms and library delivery requirements.
  • Hands-on sound design, Foley and voice-over session experience, including bed and voice-over ducking and dialogue intelligibility in short-form ads.
  • Working familiarity with generative audio tools such as Suno, Udio, Stable Audio, ElevenLabs and Adobe Enhance Speech, the ability to generate your own comparison samples, and the judgment to tell a strong result from a plausible-looking weak one.
  • A public portfolio or reel of shipped work; you will be asked to walk through it.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain creative decisions clearly.

About Cincinnatus LLC: Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.

Equal Employment Opportunity: Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.

ROLE REALITY CHECK S2S Latency & Turn-Taking Rubric • Partner Audio Standard

Field Inspection & Rubric Realities

1. Technical Task Profile

Daily production queues for Music Producer & Audio Post Specialist (AI Evaluation) focus on Audio & Speech domain verification and multi-turn rubric scoring. Evaluators audit real-time speech-to-speech streams, measuring S2S audio latency spikes, turn-taking naturalness, and barge-in interruption recovery when a user speaks over the model. Every batch is cross-checked against a reference golden set during rubric calibration to keep inter-annotator agreement and Cohen's kappa aligned across acoustic and transcript dimensions.

2. Screening Pitfalls

Automated intake for Tier 2/5 (High Volume • Fast-Track — 15-min Async / AI Screen) enforces deterministic halting criteria. During Micro1 Zara automated technical interviews, candidates are flagged if spoken or coded explanations stall beyond the S2S audio latency window, or if barge-in interruption recovery fails during live follow-up probes. On Mercor and partner asynchronous video screens, recording constraints require concise, evidence-backed walkthroughs without reading off external scripts. Across written rubric calibration gates, the #1 disqualification trigger is missing a P0 factual or spec error on a seeded golden set item, which immediately drops your Cohen's kappa and inter-annotator agreement score below cohort onboarding thresholds.

3. Benchmark Verification

Cross-referencing 22 verified active Audio & Speech contracts in our local index shows hourly compensation spanning $5/hr to $150/hr. At $70 - $120 / hr, this Music Producer & Audio Post Specialist (AI Evaluation) contract is $52/hr above the category median of $68/hr. It carries a Vetting Tier 2/5 (High Volume • Fast-Track) classification, meaning applicants who maintain consistent inter-annotator agreement on the initial golden set and respect all halting criteria during rubric calibration qualify for weekly escrow payouts and priority batch allocation.

AUDIO & SPEECH • PRE-SCREEN CHECK 0 / 3 Answered

Pre-Screen Readiness Check

Quick 3-step pre-screen check: Test your instincts against real partner grading rules for this specific role before launching the official application.

SKILL CHECK: AUDIO & SPEECH True / False • S2S Barge-in & Latency Gate

1. Speech-to-Speech Interruption Handling & Turn-Taking

True or False: In full-duplex Speech-to-Speech (S2S) voice evaluation, if a user utters a natural conversation backchannel (e.g., "uh-huh", "yeah") while the model is speaking, the model should immediately halt playback and treat the backchannel as a conversation takeover.

SKILL CHECK: LINGUISTICS & TRANSLATION Multiple Choice • Localization & Cultural Pragmatics

2. Honorific Register & Cultural Precision

When translating business customer communications from English into Japanese or Vietnamese, which factor is most crucial in evaluating human parity against machine translation?

SKILL CHECK: MERCOR VETTING Single-Choice • Mercor Case Walkthrough

3. Mercor Timed Domain & Video Case Walkthrough

When completing the timed asynchronous video and domain assessment for this partner role, what do reviewers prioritize most?