Role Description & Scope
Executive Role Brief & Overview
Join a high-impact reinforcement learning and benchmark evaluation program designed for experienced practitioners. Practitioners command $75–$140/hr with transparent time-and-task tracking and rapid weekly escrow payouts. Success in this Clinical Medicine & Diagnostic Reasoning Evaluator capacity requires deep Medical / Clinical AI Validation to adjudicate ambiguous model completions and refine training datasets. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.
- Primary Competency: Medical / Clinical AI Validation
- Credential Tier: PhD
- Candidate Profile: Ideal for PhD licensed clinicians, physicians, and healthcare specialists experienced in evidence-based diagnostic reasoning.
- Verified Compensation: $75 - $140 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Clinical Medicine & Diagnostic Reasoning Evaluator within the Healthcare & Medical track on verified partner platforms.
- Direct Compensation: Rates range from $75 to $140 per hour (category benchmark average: $133/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Benchmark frontier models on differential diagnosis, medical licensing exams, and guidelines.\nResponsibilities:\n- Evaluate clinical case vignettes for diagnostic precision and prioritized workup plans.\n- Identify medical hallucinations or unsafe treatment recommendations.\n- Align completions with evidence-based medicine (UpToDate, clinical guidelines).\nRequirements:\n- MD, DO, MBBS, or equivalent clinical medical degree.\n- Strong familiarity with USMLE-style reasoning and clinical decision protocols.