Role Description & Scope
Executive Role Brief & Overview
Accelerate frontier AI safety and domain accuracy by joining this verified remote specialist contract. Practitioners command $50–$95/hr with transparent time-and-task tracking and rapid weekly escrow payouts. In this Automated Unit & Integration Test Generation Specialist workstream, practitioners apply RLHF & LLM Rubric Evaluation to stress-test frontier model outputs against strict scoring rubrics. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. Immediate start dates are available for vetted practitioners; use our verified referral link to enter the priority review pipeline.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $50 - $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Automated Unit & Integration Test Generation Specialist within the AI Training track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $95 per hour (category benchmark average: $73/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Train AI models to generate resilient test suites across diverse programming languages.\nResponsibilities:\n- Evaluate test coverage, assertion specificity, mocking strategies, and boundary testing.\n- Design mutation testing challenges to test whether AI-generated tests detect intentional bugs.\n- Benchmark test execution speed and independence.\nRequirements:\n- Strong experience with testing frameworks (pytest, JUnit, Jest, Mockito).\n- Understanding of TDD, BDD, and code coverage metrics.