Role Description & Scope
Executive Role Brief & Overview
Our verified partner network has opened rolling allocations for this remote model calibration and rubric role. This engagement pays $55–$100/hr directly to independent contractors upon quality-verified benchmark completion. Daily workflows for the Lead Auditor - Multi-Turn Dialog Safety contract emphasize AI Training & Data Curation, comparative model ranking, and rubric-driven error taxonomy. Work entirely on your own schedule with 24/7 cloud benchmark access and flexible weekly hour commitments. Client calibration batches are actively reviewing applicants—use the verified partner portal link to fast-track your credential screening.
- Primary Competency: AI Training & Data Curation
- Credential Tier: Senior
- Candidate Profile: Ideal for Senior domain specialists with sharp written communication and critical reasoning skills for frontier AI alignment.
- Verified Compensation: $55 - $100 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Lead Auditor - Multi-Turn Dialog Safety within the Finance & Accounting track on verified partner platforms.
- Direct Compensation: Rates range from $55 to $100 per hour (category benchmark average: $104/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Lead a team of safety auditors evaluating high-risk dialog completions across sensitive categories.\nResponsibilities:\n- Conduct second-tier audits on contested safety classifications.\n- Maintain zero tolerance for P0 safety policy violations in published training splits.\n- Train new annotators on safety taxonomies and calibrated boundary criteria.\nRequirements:\n- 3+ years in Content Moderation, Trust & Safety, or AI Alignment Operations.\n- High emotional resilience and analytical decision-making capabilities.