Role Description & Scope
Executive Role Brief & Overview
This verified remote AI evaluation contract offers an immediate opportunity for specialized domain experts. Specialists are compensated at $50–$150/hr via direct weekly or bi-weekly settlements for all verified task submissions. Daily workflows for the CAD & Engineering Professionals contract emphasize RLHF & LLM Rubric Evaluation, comparative model ranking, and rubric-driven error taxonomy. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. Because cohort seats fill on a rolling basis, submit your profile early via our verified partner routing link to secure priority review.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $50 - $150 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for CAD & Engineering Professionals within the Robotics track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $150 per hour (category benchmark average: $91/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in PTC Creo, SolidWorks, AutoCAD to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
In this hourly, remote contractor role, you will work as a CAD & Engineering Professional (SME) to create realistic, challenging computer-based tasks using professional computer-aided design (CAD), engineering, architecture, and 3D modeling software.
You will design practical CAD and engineering tasks, document them clearly in SuperAnnotate, ensure your computer setup supports the task, and record yourself executing the workflow on your computer.
Tasks may include creating and modifying technical drawings, developing 2D and 3D models, designing mechanical components, architectural modeling, civil infrastructure design, industrial product development, assemblies, parametric modeling, documentation, and preparing professional design deliverables.
We are particularly interested in professionals experienced with Bentley MicroStation, McNeel Rhinoceros 3D, Autodesk AutoCAD Civil 3D, PTC Creo Parametric, Dassault Systèmes CATIA, Autodesk Revit, Dassault Systèmes SolidWorks, Autodesk AutoCAD, and Trimble SketchUp Pro.
This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your CAD and engineering expertise will directly help improve the world's premier AI models by teaching them how experienced professionals complete real-world design, modeling, and engineering workflows.
Mandatory: Applicants must be able to provide a shareable professional portfolio accessible to the SuperAnnotate team.