Role Description & Scope
Executive Role Brief & Overview
This verified remote AI evaluation contract offers an immediate opportunity for specialized domain experts. Contractors earn $60–$120/hr with guaranteed weekly payouts and priority access to bonus calibration batches. Core deliverables for the Competitive Data Scientist (Kaggle) role center on Python & Backend Engineering, multi-step reasoning verification, and factual edge-case auditing. Built for remote autonomy, this contract lets you scale your weekly hours up or down based on batch availability. Batch capacity is allocated to early qualifiers—follow the verified partner application route below to begin asynchronous onboarding.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $60 - $120 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Competitive Data Scientist (Kaggle) within the Machine Learning & AI track on verified partner platforms.
- Direct Compensation: Rates range from $60 to $120 per hour (category benchmark average: $115/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in ML Engineering, Data Science, Mathematics to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Title: Competitive Data Scientist (Kaggle)
Pay: $60–$120/hour
Location: Global, fully remote
Job Type: Contractor (~15 hours per week)
Schedule: Flexible-you choose the hours and days you work, including weekends if desired
We're looking for data scientists, machine learning practitioners, and applied mathematics experts with competitive Data Science experience on Kaggle or other platforms.
You’ll draw on your competition experience, mathematical reasoning, and programming skills to create tasks that require more than a plausible answer. Each task should have a reproducible environment, a verified reference solution, and reliable checks for successful completion.
What You’ll Do
- Build reproducible environments, prepare relevant data and dependencies, and implement reference solutions.
- Develop tests and evaluation criteria that reliably distinguish correct solutions from incomplete or flawed approaches.
- Run coding agents against tasks, investigate their failures, and refine the tasks based on observed behavior.
- Identify implementation errors, flawed assumptions, data leakage, and other issues that affect correctness.
- Document task requirements, solution reasoning, and verification steps clearly.
What We’re Looking For
- Expert rank or above on Kaggle/Similar platforms
- Strong problem-solving ability and a clear understanding of the methods you use.
- Practical programming ability sufficient to implement and verify your own solutions.
Relevant competition platforms include Kaggle, DrivenData, Zindi, AIcrowd, Numerai, DataSource.ai, and CodaLab/Codabench.
Huge Pluses
- Strong coding experience, particularly in Python, including testing, debugging, and working with unfamiliar code