Role Description & Scope
Executive Role Brief & Overview
Qualified independent professionals are invited to calibrate complex reasoning benchmarks in this remote role. The contract features transparent hourly remuneration at $50–$70/hr with zero platform commission deductions. Contributors in the Mathematics Specialist role leverage STEM & Mathematical Reasoning to benchmark model performance across high-difficulty domain scenarios. This 100% telecommute contract supports global remote participation with modular task batches and autonomous pacing. To maximize acceptance speed into the active evaluation cohort, launch your application directly via our verified partner gateway.
- Primary Competency: STEM & Mathematical Reasoning
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner quantitative researchers, mathematicians, and scientists capable of verifying multi-step symbolic and empirical proofs.
- Verified Compensation: $50 - $70 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Mathematics Specialist within the Mathematics & STEM track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $70 per hour (category benchmark average: $105/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in Problem Solving, Advanced Mathematics, Reasoning to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
SME Careers, a fast-growing AI data services company and subsidiary of SuperAnnotate, is seeking mathematicians to join our AI training project. In this role, you will review AI-generated responses, evaluate the reasoning quality and step-by-step problem-solving, and provide expert feedback that helps models produce answers that are accurate, logical, and clearly explained. You will assess solutions for accuracy, clarity, and adherence to the prompt; identify errors in calculations, methodology, or conceptual understanding; fact-check quantitative information across; write high-quality mathematical explanations and model solutions that demonstrate correct methods; and rate and compare multiple AI responses based on mathematical correctness and reasoning quality.
Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.