Home > Jobs > Business Operations > HR Expert
✓ Verified Business Operations 🔥 High Volume

HR Expert

Compensation $95 / hr
Location Remote (US preferred, open worldwide)
Available Openings 50+ openings
TIER 2/5 High Volume • Fast-Track
High Acceptance Rate
Interview Format 15-min Async / AI Screen
Insider Preparation Tip Ensure clear microphone audio and highlight direct language or evaluation experience for instant fast-tracking.
SPONSORED (728x90) Accelerate your AI benchmarks: Explore verified developer tooling & APIs

Role Description & Scope

Executive Role Brief & Overview

An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. This engagement pays $95/hr directly to independent contractors upon quality-verified benchmark completion. Success in this HR Expert capacity requires deep RLHF & LLM Rubric Evaluation to adjudicate ambiguous model completions and refine training datasets. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.

  • Primary Competency: RLHF & LLM Rubric Evaluation
  • Credential Tier: Bachelor's
  • Candidate Profile: Ideal for Bachelor's analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
  • Verified Compensation: $95 / hr

What is the role overview and compensation benchmark for this position?

  • Role Scope & Domain: Verified remote contract for HR Expert within the Business Operations track on verified partner platforms.
  • Direct Compensation: Rates range from $95 per hour (category benchmark average: $70/hr) with direct escrow disbursements.
  • Work Structure: Fully remote, flexible scheduling with independent task execution.

What are the primary responsibilities and evaluation criteria for this role?

  • Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
  • Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
  • Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.

Detailed Role Specifications & Project Scope

Role Overview

  • our verified AI client is hiring experienced HR professionals to build and review evaluation tasks for AI agents.
  • Each task is set in a realistic simulated company, with the policies, employee records, case files, emails and HR systems a people team really uses.
  • You make sure each task reads like a real request, the reference answer holds up against the source records, and the grading rubric checks what a senior HR leader would check.

Key Responsibilities

  • Refine AI-drafted task prompts so they read like a real request from an HR director or manager, without giving the answer away.
  • Check the reference answer against the world's files and app records, and correct what is wrong.
  • Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss.
  • Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
  • Work across talent acquisition and onboarding, performance management and succession, compensation, benefits and leave, employee relations and workplace investigations, separations, HR policy and employment-law compliance, people analytics, and organization design.

Ideal Qualifications

  • 3+ years of HR experience. A leadership title or major-company background is a plus, but time in the field matters more.
  • Bachelor's degree in human resources, business or a related field.
  • Ownership of talent programs, employee-relations matters or compensation design, and working knowledge of employment law (Title VII, FLSA, ADA, or UK / EU equivalents).
  • SHRM-SCP, SPHR or an international equivalent strongly preferred. Prior experience on a our verified AI client RL project is a plus.

Details

  • Pay: $95/hour.
  • You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away.
  • Strong performers can move into reviewer and world lead roles.
ROLE REALITY CHECK Standard Rubric Calibration • Multi-Turn Prompt Audit

Field Inspection & Rubric Realities

1. Technical Task Profile

Daily production batches for HR Expert center on Business Operations domain verification and multi-turn rubric scoring. Practitioners execute structured side-by-side (SxS) model evaluations, author adversarial prompts, and score multi-step chain-of-thought traces against strict rubric calibration guidelines. Every submitted batch is audited against a reference golden set to maintain high inter-annotator agreement and Cohen's kappa, while voice and multimodal queues also log S2S audio latency and barge-in interruption handling.

2. Screening Pitfalls

Automated intake for Tier 2/5 (High Volume • Fast-Track — 15-min Async / AI Screen) enforces deterministic halting criteria. During Micro1 Zara automated technical interviews, candidates are flagged if spoken or coded explanations stall beyond the S2S audio latency window, or if barge-in interruption recovery fails during live follow-up probes. On Mercor and partner asynchronous video screens, recording constraints require concise, evidence-backed walkthroughs without reading off external scripts. Across written rubric calibration gates, the #1 disqualification trigger is missing a P0 factual or spec error on a seeded golden set item, which immediately drops your Cohen's kappa and inter-annotator agreement score below cohort onboarding thresholds.

3. Benchmark Verification

Cross-referencing 38 verified active Business Operations contracts in our local index shows hourly compensation spanning $60/hr to $555/hr. At $95 / hr, this HR Expert contract is aligned directly with the $98/hr category median. It carries a Vetting Tier 2/5 (High Volume • Fast-Track) classification, meaning applicants who maintain consistent inter-annotator agreement on the initial golden set and respect all halting criteria during rubric calibration qualify for weekly escrow payouts and priority batch allocation.

BUSINESS OPERATIONS • PRE-SCREEN CHECK 0 / 3 Answered

Pre-Screen Readiness Check

Quick 3-step pre-screen check: Test your instincts against real partner grading rules for this specific role before launching the official application.

SKILL CHECK: RLHF & MODEL EVALUATION True / False • Inter-Annotator Rubric Gate

1. Rubric Calibration & Cohen's Kappa Drift

True or False: When two annotators disagree on a qualitative response tone, an acceptable method to maintain high Cohen's kappa (κ ≥ 0.80) is for one annotator to adjust their score to match their peer without documenting an explicit rubric justification.

SKILL CHECK: DATA ANNOTATION & QUALITY ASSURANCE True / False • Golden Set Compliance

2. Ambiguous Edge Cases vs. Guideline Halting Criteria

True or False: When annotating an ambiguous edge-case sample where the guidelines offer two conflicting interpretations, the annotator should guess the most likely option rather than tagging the item for supervisor escalation.

SKILL CHECK: MERCOR VETTING Single-Choice • Mercor Case Walkthrough

3. Mercor Timed Domain & Video Case Walkthrough

When completing the timed asynchronous video and domain assessment for this partner role, what do reviewers prioritize most?