Role Description & Scope
Executive Role Brief & Overview
This vetted remote AI contract connects high-caliber specialists directly with frontier model evaluation teams. The contract features transparent hourly remuneration at $80–$90/hr with zero platform commission deductions. Specialists selected for Creative & Media Expert execute structured RLHF & LLM Rubric Evaluation audits, ensuring model outputs meet production-grade domain standards. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. Priority onboarding slots remain open this week; apply through RemoteAIGig's verified partner link for expedited assessment routing.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Senior
- Candidate Profile: Ideal for Senior analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $80 - $90 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Creative & Media Expert within the Design & Creative track on verified partner platforms.
- Direct Compensation: Rates range from $80 to $90 per hour (category benchmark average: $54/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in Figma to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Overview
- our verified AI client is seeking experienced creative, media, and communications professionals to build evaluation tasks for AI systems that produce professional creative work.
- The tasks are calibrated to the quality a senior professional would deliver to a client, an employer, or a live audience.
- This role spans five areas: enterprise communication (slide decks, reports, training videos), entertainment and media (video, audio, podcasts, game assets), marketing and advertising (campaigns, social content, brand guides), staging and layouts (posters, logos, concept art), and interactive digital products (websites, HTML games). Professionals in any of these areas are encouraged to apply.
- Contributors write realistic creative briefs, prepare input files, produce reference deliverables, and judge AI-generated outputs against them.
Key Responsibilities
- Write realistic creative briefs based on your own professional practice, with a clear audience, constraints, and a single end deliverable.
- Prepare the input files a professional would receive, such as brand assets, data, footage, audio, and style references.
- Produce a finished reference deliverable for each task, at the standard you would ship to a client.
- Compare AI-generated deliverables with reference deliverables and judge which is stronger on content and on craft.
- Write concise rationales for each judgment and help refine the guidance used to grade AI outputs.
Ideal Qualifications
- 5+ years of professional experience in design, art direction, photography, film and video production, animation, sound and music, broadcasting, advertising, marketing, public relations, publishing, instructional design, or business communication.
- A portfolio of your own professional work that shows strong content and craft.
- Fluency in the professional tools of your field, such as Adobe Creative Cloud, Figma, PowerPoint or Google Slides, Premiere Pro, DaVinci Resolve, After Effects, Pro Tools, or Logic Pro.
- A sharp eye for detail and the ability to explain clearly why one piece of work is better than another.
- Prior rubric writing, AI evaluation, or creative review experience is a plus.