Role Description & Scope
Executive Role Brief & Overview
Join a high-impact reinforcement learning and benchmark evaluation program designed for experienced practitioners. This engagement pays $45–$85/hr directly to independent contractors upon quality-verified benchmark completion. In this Psychology & Behavioral Science AI Evaluator workstream, practitioners apply AI Training & Data Curation to stress-test frontier model outputs against strict scoring rubrics. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.
- Primary Competency: AI Training & Data Curation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner domain specialists with sharp written communication and critical reasoning skills for frontier AI alignment.
- Verified Compensation: $45 - $85 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Psychology & Behavioral Science AI Evaluator within the Science & Research track on verified partner platforms.
- Direct Compensation: Rates range from $45 to $85 per hour (category benchmark average: $82/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Evaluate behavioral psychology, psychometrics, and research methodology explanations.\nResponsibilities:\n- Audit experimental design critiques (confounding variables, statistical power, p-hacking).\n- Verify descriptions of psychological assessments (Big Five, WAIS, DSM-5 criteria).\n- Score model completions on human motivation, learning theory, and decision biases.\nRequirements:\n- Degree in Psychology, Behavioral Economics, or Social Science.\n- Strong grounding in quantitative research methods and ethical considerations.