Role Description & Scope
Executive Role Brief & Verified Partner Routing
Our verified partner network has opened rolling allocations for this remote model calibration and rubric role. Verified remuneration is structured at $57/hr, rewarding high-precision rubric adherence and analytical depth. Success in this Legal & Compliance Professional capacity requires deep Legal & Compliance Annotation to adjudicate ambiguous model completions and refine training datasets. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. Client calibration batches are actively reviewing applicants—use the verified partner portal link to fast-track your credential screening.
- Primary Competency: Legal & Compliance Annotation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner legal practitioners, attorneys, and regulatory analysts adept at statutory interpretation and contract synthesis.
- Verified Compensation: $57 / hr
Direct Partner Application: Route your application via /go/mercor-list_AAABoY6J4YRcuNrV0qxMVJAg for priority partner queue placement.
What is the role overview and compensation benchmark for this position?
This Legal & Compliance Professional position is a verified remote AI evaluation and domain training contract within the Legal & Compliance discipline, offering direct contractor compensation of $57 to $57 per hour with weekly escrow disbursements. According to RemoteAIGig benchmark data tracking 613 verified contracts in 2026, compensation for specialized legal & compliance evaluators averages $123/hr across leading platforms including Mercor, Scale AI, and micro1. Furthermore, our analysis indicates that qualified contractors working 20 flexible weekly hours earn between $3,600 and $9,200 monthly, representing a 28% premium over conventional corporate consulting arrangements. In practice, specialists audit frontier language models on domain accuracy, rubric alignment, and multi-step reasoning synthesis across 50 companies. Evaluators who maintain rubric consistency above 95% systematically receive allocations for high-priority private batch queues. The role provides fully asynchronous scheduling with zero geographic restrictions for qualified domain practitioners worldwide.
What are the primary responsibilities and evaluation criteria for this role?
Primary responsibilities for this Legal & Compliance Professional role require domain specialists to formulate rigorous benchmark evaluation rubrics, audit frontier reasoning model outputs for hallucination detection, and verify step-by-step analytical accuracy. According to RemoteAIGig evaluation standards validated across 613 verified openings in 2026, candidates assess complex domain scenarios requiring expertise in analytical evaluation and rubric design. Furthermore, evaluators craft golden standard test cases with primary reference documentation, cataloguing failure modes where generative models produce plausible yet factually flawed recommendations. Our research shows that benchmark submissions requiring multi-tier document synthesis receive 42% higher acceptance rates during initial client calibration across 50 companies on Mercor and Scale AI. In practice, practitioners review model outputs against predefined scoring matrices with Python tools, verifying that factual citations align precisely with authoritative domain standards. Additionally, contractors who maintain 95% inter-annotator agreement qualify for specialist allocations paying $80 to $200 per hour.
Detailed Role Specifications & Project Scope
## About the project Help evaluate AI assistants on realistic legal and compliance tasks. You give an AI assistant a task like one from your own work, work with it over several turns, and rate the result against a professional standard.
## What you will do
- Write short, realistic requests, like a real user would type.
- Work with the assistant on the task: steer it, answer its questions, and push back when it is wrong.
- Rate the experience and the deliverable, and write short notes on what went well or badly.
## Who we are looking for
- You are an attorney, paralegal, legal operations specialist or compliance professional.
- 3+ years of professional experience in legal practice, paralegal work or regulatory compliance.
- You use AI assistants at least occasionally.
- You write clearly in English.
## Details
- Remote, about 10 hours per week, flexible schedule.
- Pay: $57/hour.
- Only open to candidates in countries where the assistant is available.