Role Description & Scope
Executive Role Brief & Overview
An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. Compensation is benchmarked at $55–$95/hr, reflecting top-tier market rates for specialized AI evaluation work. In this Chain-of-Thought (CoT) Reasoning Trace Auditor workstream, practitioners apply AI Training & Data Curation to stress-test frontier model outputs against strict scoring rubrics. Flexible weekly allocations and asynchronous review pipelines make this remote contract ideal for high-performing specialists. To maximize acceptance speed into the active evaluation cohort, launch your application directly via our verified partner gateway.
- Primary Competency: AI Training & Data Curation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner domain specialists with sharp written communication and critical reasoning skills for frontier AI alignment.
- Verified Compensation: $55 - $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Chain-of-Thought (CoT) Reasoning Trace Auditor within the Finance & Accounting track on verified partner platforms.
- Direct Compensation: Rates range from $55 to $95 per hour (category benchmark average: $104/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Analyze step-by-step thinking tokens produced by frontier reasoning models.\nResponsibilities:\n- Verify each reasoning link: premise -> deduction -> sub-conclusion -> final answer.\n- Identify sneaky unfaithful reasoning (where the model arrives at the right answer via flawed steps).\n- Score reasoning conciseness versus rambling overthinking.\nRequirements:\n- Degree in Philosophy, Logic, Mathematics, or Computer Science.\n- Exceptional analytical ability to dissect formal and informal arguments.