Role Description & Scope
Executive Role Brief & Overview
Contribute your subject-matter mastery to next-generation foundation model alignment in this verified remote engagement. Contractors earn $55–$95/hr with guaranteed weekly payouts and priority access to bonus calibration batches. Specialists selected for GraphQL API Schema & Resolver Design Evaluator execute structured AI Training & Data Curation audits, ensuring model outputs meet production-grade domain standards. The platform provides round-the-clock task availability, allowing vetted specialists to contribute asynchronously across any time zone. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.
- Primary Competency: AI Training & Data Curation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner domain specialists with sharp written communication and critical reasoning skills for frontier AI alignment.
- Verified Compensation: $55 - $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for GraphQL API Schema & Resolver Design Evaluator within the Design & Creative track on verified partner platforms.
- Direct Compensation: Rates range from $55 to $95 per hour (category benchmark average: $54/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Benchmark GraphQL schema modeling, query resolution, and federation.\nResponsibilities:\n- Evaluate schema type definitions, inputs, mutations, and subscription mechanisms.\n- Audit N+1 query problem mitigations using DataLoader patterns.\n- Review Apollo Federation and schema stitching implementations.\nRequirements:\n- 3+ years building and deploying production GraphQL services.\n- Deep understanding of API governance, rate limiting, and complexity analysis.