Role Description & Scope
Executive Role Brief & Overview
Qualified independent professionals are invited to calibrate complex reasoning benchmarks in this remote role. Contractors earn $65–$120/hr with guaranteed weekly payouts and priority access to bonus calibration batches. Core deliverables for the Agent Sandboxing & Execution Safety Evaluator role center on Python & Backend Engineering, multi-step reasoning verification, and factual edge-case auditing. The workflow is 100% remote and asynchronous, enabling you to allocate 10 to 40 flexible hours per week from anywhere. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $65 - $120 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Agent Sandboxing & Execution Safety Evaluator within the Cloud & DevOps track on verified partner platforms.
- Direct Compensation: Rates range from $65 to $120 per hour (category benchmark average: $95/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in Docker to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Audit code execution permissions, network restrictions, and sandbox escape vectors in AI agents.\nResponsibilities:\n- Design adversarial prompts attempting to probe unauthorized system commands or network ports.\n- Verify that tool-calling models respect security boundaries and least-privilege principles.\n- Document vulnerability disclosures and safe mitigation strategies for client models.\nRequirements:\n- Background in Application Security, DevSecOps, or Systems Programming.\n- Experience with Docker, gVisor, or WebAssembly sandboxes.