Role Description & Scope
What is the role overview and compensation benchmark for this position?
This Smartwatch User position is a verified remote AI evaluation and domain training contract within the Design & Creative discipline, offering direct contractor compensation of $70 to $70 per hour with weekly escrow disbursements. According to RemoteAIGig benchmark data tracking 613 verified contracts in 2026, compensation for specialized design & creative evaluators averages $54/hr across leading platforms including Mercor, Scale AI, and micro1. Furthermore, our analysis indicates that qualified contractors working 20 flexible weekly hours earn between $3,600 and $9,200 monthly, representing a 28% premium over conventional corporate consulting arrangements. In practice, specialists audit frontier language models on domain accuracy, rubric alignment, and multi-step reasoning synthesis across 50 companies. Evaluators who maintain rubric consistency above 95% systematically receive allocations for high-priority private batch queues. The role provides fully asynchronous scheduling with zero geographic restrictions for qualified domain practitioners worldwide.
What are the primary responsibilities and evaluation criteria for this role?
Primary responsibilities for this Smartwatch User role require domain specialists to formulate rigorous benchmark evaluation rubrics, audit frontier reasoning model outputs for hallucination detection, and verify step-by-step analytical accuracy. According to RemoteAIGig evaluation standards validated across 613 verified openings in 2026, candidates assess complex domain scenarios requiring expertise in Heart Rate Monitoring, Sleep Tracking, Daily Smartwatch Wear. Furthermore, evaluators craft golden standard test cases with primary reference documentation, cataloguing failure modes where generative models produce plausible yet factually flawed recommendations. Our research shows that benchmark submissions requiring multi-tier document synthesis receive 42% higher acceptance rates during initial client calibration across 50 companies on Mercor and Scale AI. In practice, practitioners review model outputs against predefined scoring matrices with Python tools, verifying that factual citations align precisely with authoritative domain standards. Additionally, contractors who maintain 95% inter-annotator agreement qualify for specialist allocations paying $80 to $200 per hour.
Detailed Role Specifications & Project Scope
Role Title: Smartwatch User
Role Type: Contractor
Location: Remote
Job Summary
Get paid from home in this fully remote AI research project by sharing an export of your own wearable health data. If you own and actively wear an Oura, WHOOP, Garmin, Samsung Galaxy Watch (Samsung Health), Google Fitbit/Pixel Watch, or Apple Watch for a year and a half or more, your history could help train and evaluate AI models.
You’ll download your data export from your device account and upload it as a ZIP file through a Google Form. No special equipment is needed besides the weareble tech.
Key Responsibilities
- Log in to your own device account (Oura, WHOOP, Garmin Connect, Samsung Health, Fitbit/Google, or Apple Health) and request or download your full data export.
- Confirm your export covers the required time period and includes the required data types.
- Upload the unedited export as a ZIP file through the provided Google Form.
- Follow the instructions carefully and do not alter, delete, or filter your data.
- Report any issues, such as failed exports or missing data, and respond to feedback so your submission can be accepted.
Required Qualifications
- Supported device: Oura, WHOOP, Garmin, Samsung Galaxy Watch/Samsung Health, Google Fitbit/Pixel Watch, or Apple Watch.
- Data history: At least 18 months of continuous data, with no gap longer than 6 weeks.
- Recent activity: Data recorded within the last 6 months.
- Data types: Tracking of at least two of the following: sleep, activity, or heart rate.
- Account access: Login access to your own device account.
- Technical comfort: Able to download files and upload a ZIP through a Google Form.
- Able to follow instructions, pay attention to detail, and work independently.
Preferred Qualifications
- Data from multiple devices or accounts.
- 3+ years of history.
- Broad data coverage across multiple categories, such as sleep, fitness, activity, and heart rate.
Compensation Structure:
- You will receive a payment of $70 per data of device submitted, paid after your data is reviewed and meets the project requirements.