Role Description & Scope
Executive Role Brief & Overview
A leading frontier AI research initiative is onboarding vetted domain specialists for this remote role. This engagement pays $50–$90/hr directly to independent contractors upon quality-verified benchmark completion. In this Computer Vision Annotation Quality Specialist workstream, practitioners apply RLHF & LLM Rubric Evaluation to stress-test frontier model outputs against strict scoring rubrics. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $50 - $90 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Computer Vision Annotation Quality Specialist within the Machine Learning & AI track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $90 per hour (category benchmark average: $115/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in Computer Vision to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Audit bounding box, polygon segmentation, and keypoint annotations for autonomous vision models.\nResponsibilities:\n- Verify pixel-level segmentation accuracy and strict boundary tightness.\n- Review 3D LiDAR point cloud annotations and cuboid tracking.\n- Enforce quality rubrics across annotator batches to ensure Intersection over Union (IoU > 0.90).\nRequirements:\n- 2+ years experience in computer vision annotation review and quality control.\n- High spatial perception and attention to visual detail.