Role Description & Scope
Executive Role Brief & Overview
A leading frontier AI research initiative is onboarding vetted domain specialists for this remote role. The contract features transparent hourly remuneration at $52–$92/hr with zero platform commission deductions. Contributors in the Video Reasoning & Action Segmentation Evaluator role leverage RLHF & LLM Rubric Evaluation to benchmark model performance across high-difficulty domain scenarios. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. Priority onboarding slots remain open this week; apply through RemoteAIGig's verified partner link for expedited assessment routing.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $52 - $92 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Video Reasoning & Action Segmentation Evaluator within the AI Training track on verified partner platforms.
- Direct Compensation: Rates range from $52 to $92 per hour (category benchmark average: $73/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Benchmark video generative and understanding models on temporal coherence and causality.\nResponsibilities:\n- Audit video understanding models on timestamped action localization and event sequencing.\n- Benchmark generative video for physics violations (morphing bodies, object permanence failures).\n- Evaluate multi-turn video question-answering (VideoQA) completions.\nRequirements:\n- Strong visual perception and analytical writing ability.\n- Experience with video editing, animation, or multimodal AI benchmarking.