Role Description & Scope
Executive Role Brief & Overview
An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. This engagement pays $95/hr directly to independent contractors upon quality-verified benchmark completion. Success in this HR Expert capacity requires deep RLHF & LLM Rubric Evaluation to adjudicate ambiguous model completions and refine training datasets. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Bachelor's
- Candidate Profile: Ideal for Bachelor's analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for HR Expert within the Business Operations track on verified partner platforms.
- Direct Compensation: Rates range from $95 per hour (category benchmark average: $70/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Overview
- our verified AI client is hiring experienced HR professionals to build and review evaluation tasks for AI agents.
- Each task is set in a realistic simulated company, with the policies, employee records, case files, emails and HR systems a people team really uses.
- You make sure each task reads like a real request, the reference answer holds up against the source records, and the grading rubric checks what a senior HR leader would check.
Key Responsibilities
- Refine AI-drafted task prompts so they read like a real request from an HR director or manager, without giving the answer away.
- Check the reference answer against the world's files and app records, and correct what is wrong.
- Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss.
- Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
- Work across talent acquisition and onboarding, performance management and succession, compensation, benefits and leave, employee relations and workplace investigations, separations, HR policy and employment-law compliance, people analytics, and organization design.
Ideal Qualifications
- 3+ years of HR experience. A leadership title or major-company background is a plus, but time in the field matters more.
- Bachelor's degree in human resources, business or a related field.
- Ownership of talent programs, employee-relations matters or compensation design, and working knowledge of employment law (Title VII, FLSA, ADA, or UK / EU equivalents).
- SHRM-SCP, SPHR or an international equivalent strongly preferred. Prior experience on a our verified AI client RL project is a plus.
Details
- Pay: $95/hour.
- You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away.
- Strong performers can move into reviewer and world lead roles.