Role Description & Scope
Executive Role Brief & Overview
Our verified partner network has opened rolling allocations for this remote model calibration and rubric role. This engagement pays $48–$85/hr directly to independent contractors upon quality-verified benchmark completion. As a Audio & Speech Synthesis Quality Evaluator, your primary focus involves Audio / Speech-to-Speech Evaluation, synthesizing gold-standard responses, and flagging subtle model hallucinations. The platform provides round-the-clock task availability, allowing vetted specialists to contribute asynchronously across any time zone. Immediate start dates are available for vetted practitioners; use our verified referral link to enter the priority review pipeline.
- Primary Competency: Audio / Speech-to-Speech Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner voice professionals, acoustic annotators, and speech evaluators focused on prosody, clarity, and transcription fidelity.
- Verified Compensation: $48 - $85 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Audio & Speech Synthesis Quality Evaluator within the Audio & Speech track on verified partner platforms.
- Direct Compensation: Rates range from $48 to $85 per hour (category benchmark average: $52/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Evaluate text-to-speech (TTS) and speech-to-speech (S2S) model outputs for fidelity and emotion.\nResponsibilities:\n- Score synthetic audio on Mean Opinion Score (MOS) metrics: naturalness, prosody, pronunciation.\n- Identify audio artifacts: clicks, robotic cadence, unnatural breathing, phoneme distortion.\n- Evaluate voice cloning models for speaker similarity and timbre consistency.\nRequirements:\n- Background in Audio Engineering, Acoustics, Linguistics, or Voice Talent.\n- Trained critical listening skills and high-fidelity audio monitoring setup.