Role Description & Scope
Executive Role Brief & Overview
Qualified independent professionals are invited to calibrate complex reasoning benchmarks in this remote role. The contract features transparent hourly remuneration at $70–$125/hr with zero platform commission deductions. The Web3 & Smart Contract Solidity AI Evaluator assignment demands rigorous AI Training & Data Curation to author complex prompts and evaluate chain-of-thought reasoning. The workflow is 100% remote and asynchronous, enabling you to allocate 10 to 40 flexible hours per week from anywhere. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.
- Primary Competency: AI Training & Data Curation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner domain specialists with sharp written communication and critical reasoning skills for frontier AI alignment.
- Verified Compensation: $70 - $125 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Web3 & Smart Contract Solidity AI Evaluator within the Design & Creative track on verified partner platforms.
- Direct Compensation: Rates range from $70 to $125 per hour (category benchmark average: $54/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Evaluate smart contract generation on Ethereum and EVM-compatible chains.\nResponsibilities:\n- Audit Solidity code for reentrancy, integer overflows, gas optimization, and access control.\n- Evaluate unit tests written in Foundry or Hardhat.\n- Score model responses explaining ERC standards (ERC-20, ERC-721, ERC-1155, ERC-4337).\nRequirements:\n- 2+ years of smart contract development experience in Solidity.\n- Deep understanding of EVM execution, gas mechanics, and DeFi security patterns.