Role Description & Scope
Executive Role Brief & Overview
Shape the reasoning reliability of frontier language models through this verified independent contractor engagement. This engagement pays $95/hr directly to independent contractors upon quality-verified benchmark completion. Core deliverables for the Accounting Expert role center on RLHF & LLM Rubric Evaluation, multi-step reasoning verification, and factual edge-case auditing. Built for remote autonomy, this contract lets you scale your weekly hours up or down based on batch availability. Immediate start dates are available for vetted practitioners; use our verified referral link to enter the priority review pipeline.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Bachelor's
- Candidate Profile: Ideal for Bachelor's analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Accounting Expert within the Finance & Accounting track on verified partner platforms.
- Direct Compensation: Rates range from $95 per hour (category benchmark average: $104/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Overview
- our verified AI client is hiring experienced accountants and auditors to build and review evaluation tasks for AI agents.
- Each task is set in a realistic simulated company, with the ledgers, workpapers, policies, emails and business apps an accounting team really uses.
- You make sure each task reads like a real request, the reference answer holds up against the source records, and the grading rubric checks what a senior accountant would check.
Key Responsibilities
- Refine AI-drafted task prompts so they read like a real request from a controller, CFO or audit lead, without giving the answer away.
- Check the reference answer against the world's files and app records, and correct what is wrong.
- Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss.
- Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
- Work across financial reporting and technical accounting (revenue recognition, leases, consolidation, business combinations, SEC reporting), month-end and year-end close, internal controls and SOX, tax provisions, audit fieldwork, and industry areas such as fund, nonprofit, construction and SaaS accounting.
Ideal Qualifications
- 3+ years as an accountant, controller or audit partner. Big Four or major-corporation experience preferred.
- Bachelor's degree in accounting, finance or a related field.
- Active CPA license, or an equivalent such as CPA Canada, CPA Australia, CA, ACCA or ICAEW.
- Hands-on ownership of financial reporting, audit engagements or technical accounting, with working knowledge of US GAAP / IFRS, SEC filings and PCAOB / ISA standards.
- Prior experience on a our verified AI client RL project is a plus.
Details
- Pay: $95/hour.
- You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away.
- Strong performers can move into reviewer and world lead roles.