Role Description & Scope
Executive Role Brief & Overview
This vetted remote AI contract connects high-caliber specialists directly with frontier model evaluation teams. Specialists are compensated at $21–$45/hr via direct weekly or bi-weekly settlements for all verified task submissions. As a Generalist (US Only), your primary focus involves RLHF & LLM Rubric Evaluation, synthesizing gold-standard responses, and flagging subtle model hallucinations. Work entirely on your own schedule with 24/7 cloud benchmark access and flexible weekly hour commitments. Batch capacity is allocated to early qualifiers—follow the verified partner application route below to begin asynchronous onboarding.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $21 - $45 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Generalist (US Only) within the Design & Creative track on verified partner platforms.
- Direct Compensation: Rates range from $21 to $45 per hour (category benchmark average: $54/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in image data annotation, attention to detail, written and verbal communication to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
AI Image Evaluation Specialist
Role type: Contractor, part-time, project-based
Location: Remote, United States only
About the role
our verified AI client is looking for detail-oriented individuals to support an AI image evaluation project. You'll upload your own original images and compare them with AI-generated versions, identifying visual differences, flaws, and inconsistencies.
This role is ideal for someone with a sharp eye for detail, strong writing skills, and the patience to evaluate images thoroughly. Basic familiarity with AI-generated images is required, but specialized AI experience is not.
What you'll do
Upload your own original images for evaluation tasks.
Compare original images with AI-generated versions to identify differences and visual artifacts.
Spot inconsistencies in details such as lighting, textures, proportions, and overall image quality.
Document findings through clear, accurate written feedback.
Follow evaluation guidelines carefully, prioritizing accuracy and thoroughness.
Requirements
Must be based in the United States.
Excellent written English, with strong grammar and spelling.
Exceptional attention to detail and the ability to identify subtle visual differences.
Patience and a meticulous approach to repetitive evaluation tasks.
Basic understanding of AI image generation and common AI-generated image flaws.
Ability to provide clear, precise, and well-structured written feedback.
Application process
Candidates will complete an AI interview as part of the selection process.
About our verified AI client
our verified AI client is a data lab that connects professionals with opportunities to apply their expertise to customer projects. We work with specialists across fields such as engineering, finance, healthcare, and law to support AI labs and enterprises. Through our extended network, contributors bring their knowledge and judgment to projects with their own scope, requirements, and engagement terms.