Role Description & Scope
Executive Role Brief & Verified Partner Routing
Accelerate frontier AI safety and domain accuracy by joining this verified remote specialist contract. This engagement pays $150/hr directly to independent contractors upon quality-verified benchmark completion. Success in this Open Source Maintainer / Core Contributor – Software Engineer capacity requires deep Python & Backend Engineering to adjudicate ambiguous model completions and refine training datasets. Contributors enjoy complete geographic freedom and asynchronous task queues that fit seamlessly around existing commitments. Immediate start dates are available for vetted practitioners; use our verified referral link to enter the priority review pipeline.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Senior
- Candidate Profile: Ideal for Senior software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $150 / hr
Direct Partner Application: Route your application via /go/mercor-list_AAABoZ5Af5H0GMoyXaBBDKW2 for priority partner queue placement.
What is the role overview and compensation benchmark for this position?
This Open Source Maintainer / Core Contributor – Software Engineer position is a verified remote AI evaluation and domain training contract within the Cloud & DevOps discipline, offering direct contractor compensation of $150 to $150 per hour with weekly escrow disbursements. According to RemoteAIGig benchmark data tracking 613 verified contracts in 2026, compensation for specialized cloud & devops evaluators averages $95/hr across leading platforms including Mercor, Scale AI, and micro1. Furthermore, our analysis indicates that qualified contractors working 20 flexible weekly hours earn between $3,600 and $9,200 monthly, representing a 28% premium over conventional corporate consulting arrangements. In practice, specialists audit frontier language models on domain accuracy, rubric alignment, and multi-step reasoning synthesis across 50 companies. Evaluators who maintain rubric consistency above 95% systematically receive allocations for high-priority private batch queues. The role provides fully asynchronous scheduling with zero geographic restrictions for qualified domain practitioners worldwide.
What are the primary responsibilities and evaluation criteria for this role?
Primary responsibilities for this Open Source Maintainer / Core Contributor – Software Engineer role require domain specialists to formulate rigorous benchmark evaluation rubrics, audit frontier reasoning model outputs for hallucination detection, and verify step-by-step analytical accuracy. According to RemoteAIGig evaluation standards validated across 613 verified openings in 2026, candidates assess complex domain scenarios requiring expertise in Docker. Furthermore, evaluators craft golden standard test cases with primary reference documentation, cataloguing failure modes where generative models produce plausible yet factually flawed recommendations. Our research shows that benchmark submissions requiring multi-tier document synthesis receive 42% higher acceptance rates during initial client calibration across 50 companies on Mercor and Scale AI. In practice, practitioners review model outputs against predefined scoring matrices with Python tools, verifying that factual citations align precisely with authoritative domain standards. Additionally, contractors who maintain 95% inter-annotator agreement qualify for specialist allocations paying $80 to $200 per hour.
Detailed Role Specifications & Project Scope
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.
# 1\. Overview
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented open-source maintainers and core contributors with deep, hands-on ownership of a mature, widely used open-source codebase to bring real-world engineering and code review judgment and elevate the quality of our AI training data. This is a full-time commitment of 40 hours per week.
This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.
# 2\. Key Responsibilities
- Guide research and engineering teams to close knowledge gaps and improve AI model performance in software engineering, code review, and open-source maintenance topics.
- Design challenging, realistic engineering tasks grounded in the open-source codebase the expert knows best, such as the features, refactors and bug fixes a maintainer would assign, and write accurate, well-structured reference solutions.
- Evaluate AI-written code, tests and grading rubrics against the repository's architecture, conventions and quality bar, and provide clear, written technical feedback.
- Build, run and test the project locally, including with Docker, to confirm that tasks, solutions and tests behave as intended.
- Write precise rationales that explain what a strong solution looks like and where AI-generated changes fall short.
- Collaborate with other subject matter experts to ensure consistency and accuracy in training data.
# 3\. Core Qualifications
- Maintainer (named in MAINTAINERS or CODEOWNERS, or 10+ PR reviews in the last 12 months) or core contributor (3+ substantive merged PRs in the last 12 months) of a widely used open-source project.
- The repository is 2+ years old, has real users and an active code review culture, and is primarily human-written.
- Years of sustained open-source contributions, with a public history that can be verified against the candidate's own GitHub account.
- Senior-level code review judgment, including the ability to critically assess AI-written code, tests and edge cases.
- Hands-on ability to build and run the project and its test suite locally, including with Docker.
- Ability to engage reliably for 40 hours/week during weekdays on an exclusive basis: no other full-time role and no other AI training or evaluation projects, including other our verified AI client projects, during the engagement.
- Authorized to work in the United States on a W-2 basis.
- Able to complete any necessary background checks and confidentiality agreements before starting, and to work on a company-provided device to protect the security of information.
- Writes all rationales and feedback personally, in their own words.
- Strong written communication skills and the ability to explain complex technical decisions clearly.
About Cincinnatus LLC: Cincinnatus LLC is an enterprise staffing company that partners with leading technology companies to source and employ highly skilled professionals for contingent and contract-based opportunities. Cincinnatus serves as the employer of record for these engagements, providing W-2 employment, payroll, benefits, and compliance, while placing employees directly within client teams to work on high-impact initiatives.
Equal Employment Opportunity: Cincinnatus is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or any other legally protected characteristic.