Home > Jobs > Science & Research > Economics Research Expert
✓ Verified Science & Research 🔥 High Volume

Economics Research Expert

Compensation $150 - $160 / hr
Location Remote
Available Openings 50+ openings
TIER 5/5 Top 1% Benchmark
Priority Expert Compensation
Interview Format Deep Domain & System Design
Insider Preparation Tip Prepare concrete metrics from production systems or clinical/research credentials during the technical probe.
SPONSORED (728x90) Accelerate your AI benchmarks: Explore verified developer tooling & APIs

Role Description & Scope

Executive Role Brief & Overview

Qualified independent professionals are invited to calibrate complex reasoning benchmarks in this remote role. The contract features transparent hourly remuneration at $150–$160/hr with zero platform commission deductions. As a Economics Research Expert, your primary focus involves AI Training & Data Curation, synthesizing gold-standard responses, and flagging subtle model hallucinations. Work entirely on your own schedule with 24/7 cloud benchmark access and flexible weekly hour commitments. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.

  • Primary Competency: AI Training & Data Curation
  • Credential Tier: PhD
  • Candidate Profile: Ideal for PhD domain specialists with sharp written communication and critical reasoning skills for frontier AI alignment.
  • Verified Compensation: $150 - $160 / hr

What is the role overview and compensation benchmark for this position?

  • Role Scope & Domain: Verified remote contract for Economics Research Expert within the Science & Research track on verified partner platforms.
  • Direct Compensation: Rates range from $150 to $160 per hour (category benchmark average: $82/hr) with direct escrow disbursements.
  • Work Structure: Fully remote, flexible scheduling with independent task execution.

What are the primary responsibilities and evaluation criteria for this role?

  • Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
  • Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
  • Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.

Detailed Role Specifications & Project Scope

our verified AI client is recruiting Economics Research Experts for a research project with a leading foundational model AI lab.

You are a great fit if you:

  • Have at least 2 years of experience working for top institutions, leading economics research (e.g. World Bank, IMF, Fed, Graduate Schools)
  • PhD in Economics

Here are more details about the role:

  • You must be able to commit at least 10 hours per week for this role
  • This is a minimum four week engagement
  • Successful contributions increase the odds that you are selected on future projects with our verified AI client
ROLE REALITY CHECK Domain Expert Precision & Citation Verification • High-Stakes Eval

Field Inspection & Rubric Realities

1. Technical Task Profile

Daily specialist queues for Economics Research Expert require deep verification across Science & Research domain verification and multi-turn rubric scoring. Contributors audit multi-step domain reasoning, verify primary-source citations or quantitative derivations, and rewrite flawed model completions to gold-standard accuracy. Each task batch undergoes strict rubric calibration against a seeded golden set to sustain inter-annotator agreement and Cohen's kappa, including S2S audio latency and barge-in interruption checks when auditing voice-enabled domain assistants.

2. Screening Pitfalls

Automated intake for Tier 5/5 (Top 1% Benchmark — Deep Domain & System Design) enforces deterministic halting criteria. During Micro1 Zara automated technical interviews, candidates are flagged if spoken or coded explanations stall beyond the S2S audio latency window, or if barge-in interruption recovery fails during live follow-up probes. On Mercor and partner asynchronous video screens, recording constraints require concise, evidence-backed walkthroughs without reading off external scripts. Across written rubric calibration gates, the #1 disqualification trigger is missing a P0 factual or spec error on a seeded golden set item, which immediately drops your Cohen's kappa and inter-annotator agreement score below cohort onboarding thresholds.

3. Benchmark Verification

Cross-referencing 42 verified active Science & Research contracts in our local index shows hourly compensation spanning $8/hr to $200/hr. At $150 - $160 / hr, this Economics Research Expert contract is $50/hr above the category median of $110/hr. It carries a Vetting Tier 5/5 (Top 1% Benchmark) classification, meaning applicants who maintain consistent inter-annotator agreement on the initial golden set and respect all halting criteria during rubric calibration qualify for weekly escrow payouts and priority batch allocation.

SCIENCE & RESEARCH • PRE-SCREEN CHECK 0 / 3 Answered

Pre-Screen Readiness Check

Quick 3-step pre-screen check: Test your instincts against real partner grading rules for this specific role before launching the official application.

SKILL CHECK: RLHF & MODEL EVALUATION True / False • Inter-Annotator Rubric Gate

1. Rubric Calibration & Cohen's Kappa Drift

True or False: When two annotators disagree on a qualitative response tone, an acceptable method to maintain high Cohen's kappa (κ ≥ 0.80) is for one annotator to adjust their score to match their peer without documenting an explicit rubric justification.

SKILL CHECK: DATA ANNOTATION & QUALITY ASSURANCE True / False • Golden Set Compliance

2. Ambiguous Edge Cases vs. Guideline Halting Criteria

True or False: When annotating an ambiguous edge-case sample where the guidelines offer two conflicting interpretations, the annotator should guess the most likely option rather than tagging the item for supervisor escalation.

SKILL CHECK: MERCOR VETTING Single-Choice • Mercor Case Walkthrough

3. Mercor Timed Domain & Video Case Walkthrough

When completing the timed asynchronous video and domain assessment for this partner role, what do reviewers prioritize most?