Role Description & Scope
Executive Role Brief & Overview
Shape the reasoning reliability of frontier language models through this verified independent contractor engagement. The contract features transparent hourly remuneration at $50–$88/hr with zero platform commission deductions. Daily workflows for the OCR & Document Understanding AI Benchmark Specialist contract emphasize RLHF & LLM Rubric Evaluation, comparative model ranking, and rubric-driven error taxonomy. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. Client calibration batches are actively reviewing applicants—use the verified partner portal link to fast-track your credential screening.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $50 - $88 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for OCR & Document Understanding AI Benchmark Specialist within the AI Training track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $88 per hour (category benchmark average: $73/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Benchmark vision-language models on complex document layout analysis and table extraction.\nResponsibilities:\n- Evaluate extraction of complex multi-column tables, scanned forms, and handwritten text.\n- Audit structured markdown / HTML table representations against original PDF layouts.\n- Formulate test sets with poor scan quality, rotations, and skewed documents.\nRequirements:\n- Experience with document processing pipelines, OCR tools, and structured data formats.\n- Meticulous attention to character-level accuracy.