Role Description & Scope
Executive Role Brief & Overview
This vetted remote AI contract connects high-caliber specialists directly with frontier model evaluation teams. Contractors earn $50–$85/hr with guaranteed weekly payouts and priority access to bonus calibration batches. Core deliverables for the Model Hallucination & Factuality Verification Auditor role center on RLHF & LLM Rubric Evaluation, multi-step reasoning verification, and factual edge-case auditing. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. Because cohort seats fill on a rolling basis, submit your profile early via our verified partner routing link to secure priority review.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: PhD
- Candidate Profile: Ideal for PhD analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $50 - $85 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Model Hallucination & Factuality Verification Auditor within the Finance & Accounting track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $85 per hour (category benchmark average: $104/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Audit model factual accuracy against authoritative citations and primary research sources.\nResponsibilities:\n- Trace every empirical claim in model output to verifiable, peer-reviewed sources.\n- Categorize hallucinations: fabricated citations, chronological distortion, entity confusion.\n- Grade retrieval-augmented generation (RAG) outputs for faithful adherence to context documents.\nRequirements:\n- Strong research background (Master's or PhD preferred, or journalism/fact-checking experience).\n- Relentless attention to factual detail and rigorous citation standards.