Role Description & Scope
Executive Role Brief & Overview
Join a high-impact reinforcement learning and benchmark evaluation program designed for experienced practitioners. Compensation is benchmarked at $150/hr, reflecting top-tier market rates for specialized AI evaluation work. Contributors in the Pediatrician (MD) role leverage Medical / Clinical AI Validation to benchmark model performance across high-difficulty domain scenarios. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. Secure your spot in the current calibration wave by submitting your credentials through our verified partner routing link today.
- Primary Competency: Medical / Clinical AI Validation
- Credential Tier: PhD
- Candidate Profile: Ideal for PhD licensed clinicians, physicians, and healthcare specialists experienced in evidence-based diagnostic reasoning.
- Verified Compensation: $150 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Pediatrician (MD) within the Healthcare & Medical track on verified partner platforms.
- Direct Compensation: Rates range from $150 per hour (category benchmark average: $133/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
our verified AI client is hiring pediatricians (MD) on behalf of a healthcare AI partner building advanced clinical documentation tools. In this role you will apply your pediatric clinical expertise to review, annotate, and evaluate clinical documentation, directly shaping the accuracy, safety, and clinical usefulness of medical AI systems.
## Key Responsibilities
Clinical Documentation Review
- Review pediatric clinical documentation and patient charts for accuracy, completeness, and clinical soundness
- Evaluate AI-generated clinical summaries against what a practicing pediatrician would expect to see
Annotation & Structured Feedback
- Annotate clinical encounter data against detailed guidelines
- Flag omissions, hallucinations, clinical inaccuracies, and documentation gaps in AI-generated output
- Provide structured, written feedback that engineering and product teams can act on
Knowledge Contribution
- Contribute expert input on annotation guidelines and edge-case definitions
- Raise clarifying questions where guidance is ambiguous and help refine the guidelines
## Required Qualifications
- MD with a background as a pediatrician
-
US-based
- Available for a minimum of 10 hours/week through mid-November
## Preferred Qualifications
- Prior AI/ML annotation or model evaluation experience (with positive performance reviews)
## Work Arrangement
- Remote, part-time
- Flexible scheduling, designed around an active clinical practice