Role Description & Scope
Executive Role Brief & Overview
Step into a high-priority remote AI evaluation workstream built for rigorous analytical practitioners. Contractors earn $60–$90/hr with guaranteed weekly payouts and priority access to bonus calibration batches. The Tax Practitioner, Federal Individual Income Tax (CPA/EA/Tax Attorney) assignment demands rigorous Legal & Compliance Annotation to author complex prompts and evaluate chain-of-thought reasoning. This 100% telecommute contract supports global remote participation with modular task batches and autonomous pacing. Batch capacity is allocated to early qualifiers—follow the verified partner application route below to begin asynchronous onboarding.
- Primary Competency: Legal & Compliance Annotation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner legal practitioners, attorneys, and regulatory analysts adept at statutory interpretation and contract synthesis.
- Verified Compensation: $60 - $90 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Tax Practitioner, Federal Individual Income Tax (CPA/EA/Tax Attorney) within the Legal & Compliance track on verified partner platforms.
- Direct Compensation: Rates range from $60 to $90 per hour (category benchmark average: $123/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in federal individual income tax law interpretation, internal revenue code analysis, tax research and compliance to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Title: Tax Practitioner, Federal Individual Income Tax (CPA/EA/Tax Attorney)
Role Type: Contractor
Location: Remote (US or India)
our verified AI client is engaging Tax Practitioners, Federal Individual Income Tax (CPA/EA/Tax Attorney)s to participate in a project supporting a customer. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Read and interpret federal individual income tax law, including the Internal Revenue Code, Treasury regulations, and IRS guidance at the level of specific subsections and provisions.
- Develop precise rubrics and checklists that define the requirements a correct answer must satisfy, grounded strictly in authoritative sources.
- Assign technical severity to each requirement, accurately distinguishing between critical, secondary, and minor elements.
- Review and evaluate AI-generated tax analyses and computations, scoring each response against your criteria for accuracy and completeness.
- Compose detailed, self-contained test scenarios (including edge cases) for criteria that fail, specifying facts, dates, filing status, and expected results.
- Identify and flag ambiguities, statutory exceptions, or conflicts in the law or guidance, providing structured written feedback within the digital review platform.
- Submit clear, structured written evaluations to support ongoing system improvement.
Preferred Qualifications
- Active CPA license, Enrolled Agent designation, or experience as a US tax attorney with federal individual income tax focus.
- Extensive hands-on experience preparing or planning federal personal income tax matters for individuals.
- Demonstrated ability to read, analyze, and interpret the Internal Revenue Code, regulations, and related guidance beyond simple return preparation.
- Proficiency with legal logic constructs, such as conditions, thresholds, phase-outs, exceptions, and defined terms.
- Exceptional written communication skills with an emphasis on clarity, objectivity, and reproducibility of criteria and outcomes.
- Familiarity with complex return issues such as investments, self-employment income, equity compensation, rental property, or multi-state/international items.
- Interest in the intersection of tax compliance and technology, especially as it relates to AI and digital review platforms.