Role Description & Scope
Executive Role Brief & Overview
Qualified independent professionals are invited to calibrate complex reasoning benchmarks in this remote role. Compensation is benchmarked at $70–$125/hr, reflecting top-tier market rates for specialized AI evaluation work. In this Technical Program Manager - Frontier Model Fine-Tuning workstream, practitioners apply RLHF & LLM Rubric Evaluation to stress-test frontier model outputs against strict scoring rubrics. The platform provides round-the-clock task availability, allowing vetted specialists to contribute asynchronously across any time zone. To maximize acceptance speed into the active evaluation cohort, launch your application directly via our verified partner gateway.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $70 - $125 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Technical Program Manager - Frontier Model Fine-Tuning within the Machine Learning & AI track on verified partner platforms.
- Direct Compensation: Rates range from $70 to $125 per hour (category benchmark average: $115/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in LLM to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Orchestrate complex AI post-training workstreams between research clients and specialized annotator teams.\nResponsibilities:\n- Define sprint milestones, delivery pipelines, and resource allocations for custom LLM fine-tuning.\n- Track project health metrics, throughput rates, and budget utilization.\n- Facilitate weekly technical syncs with frontier AI research leadership.\nRequirements:\n- 4+ years of Technical Program Management in AI/ML, SaaS, or Data Infrastructure.\n- Excellent stakeholder management and technical communication skills.