Role Description & Scope
Executive Role Brief & Overview
This verified remote AI evaluation contract offers an immediate opportunity for specialized domain experts. Specialists are compensated at $55–$100/hr via direct weekly or bi-weekly settlements for all verified task submissions. Contributors in the RLHF Safety & Red Teaming Specialist role leverage Python & Backend Engineering to benchmark model performance across high-difficulty domain scenarios. Flexible weekly allocations and asynchronous review pipelines make this remote contract ideal for high-performing specialists. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $55 - $100 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for RLHF Safety & Red Teaming Specialist within the Cybersecurity track on verified partner platforms.
- Direct Compensation: Rates range from $55 to $100 per hour (category benchmark average: $89/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in RLHF, Cybersecurity to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Perform adversarial red teaming and safety evaluation on frontier generative AI systems.\nResponsibilities:\n- Stress test models against CBRN, cyberattack weaponization, self-harm, and fraud prompts.\n- Classify nuanced boundary cases where helpfulness conflicts with safety principles.\n- Author high-quality contrastive safe-completion examples for policy alignment.\nRequirements:\n- Background in AI Safety, Cybersecurity, Ethics, or Public Policy.\n- Exceptional critical thinking and rigorous documentation standards.