Role Description & Scope
Executive Role Brief & Overview
This verified remote AI evaluation contract offers an immediate opportunity for specialized domain experts. The contract features transparent hourly remuneration at $60–$120/hr with zero platform commission deductions. Success in this AI Trainer (ML Engineering) capacity requires deep RLHF & LLM Rubric Evaluation to adjudicate ambiguous model completions and refine training datasets. Designed for independent professionals, this engagement offers fully self-paced scheduling with no mandatory daily standups. Because cohort seats fill on a rolling basis, submit your profile early via our verified partner routing link to secure priority review.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $60 - $120 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for AI Trainer (ML Engineering) within the Machine Learning & AI track on verified partner platforms.
- Direct Compensation: Rates range from $60 to $120 per hour (category benchmark average: $115/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in ML Engineering, AI training, Programming Skills to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Pay: $60–$120/hour equivalent, paid per accepted task
Location: Global, fully remote
Job Type: Contractor
Time Commitment: 15+ hours per week
Schedule: Flexible
our verified AI client is looking for Machine Learning Engineers with prior professional AI-training or model-evaluation experience to support a project focused on improving advanced AI systems.
You will use your machine learning expertise to create challenging technical tasks, evaluate model-generated work, identify failures, and establish objective standards for correct solutions. This role is intended for candidates who have already completed substantive AI-training work.
What You’ll Work On
- Create realistic machine learning engineering tasks that challenge advanced AI models.
- Develop task instructions, reproducible environments, reference solutions, and evaluation criteria.
- Evaluate model-generated code, experiments, analyses, and technical deliverables.
- Identify issues involving data leakage, incorrect validation, unstable training, performance, or reproducibility.
Required Qualifications
- Prior paid experience training, evaluating, benchmarking, or improving AI systems.
- Strong practical proficiency with Python.
- Hands-on experience using PyTorch, JAX, TensorFlow, scikit-learn, XGBoost, LightGBM, or comparable ML tools.
Public Proof of Skill
Strong applicants should provide evidence such as:
- GitHub repositories or public model implementations
- Kaggle, DrivenData, AIcrowd, or similar competition results
- Hugging Face models or datasets
- Research publications or technical reports
- Open-source ML contributions
- Public benchmarks, experiments, or technical projects
Preferred Qualifications
- Experience creating AI-training tasks, reference answers, rubrics, graders, or benchmark problems.
- Experience reviewing other AI trainers’ technical submissions.
- Kaggle Expert, Master, or Grandmaster status, or strong results in another technical competition.
- Publications or open-source contributions in machine learning.
- Prior experience with long-horizon or agentic AI evaluations.
- Availability to begin immediately.
Application Process
- Submit your application, AI-training experience, and public technical evidence.
- Complete an AI interview containing technical and integrity checks.
- Complete a hiring-manager review.
- If selected, complete project onboarding and begin your first assigned task.
Compensation
- Compensation is output-based. Experts are paid for tasks that meet project specifications and quality requirements. Task availability and completion time may vary.