Role Description & Scope
Executive Role Brief & Overview
An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. Approved contributors receive direct contractor compensation of $55–$95/hr, disbursed on a reliable weekly escrow schedule. Success in this Agentic Browser Automation Evaluator - Playwright & Puppeteer capacity requires deep Python & Backend Engineering to adjudicate ambiguous model completions and refine training datasets. The platform provides round-the-clock task availability, allowing vetted specialists to contribute asynchronously across any time zone. Immediate start dates are available for vetted practitioners; use our verified referral link to enter the priority review pipeline.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $55 - $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Agentic Browser Automation Evaluator - Playwright & Puppeteer within the Software Engineering track on verified partner platforms.
- Direct Compensation: Rates range from $55 to $95 per hour (category benchmark average: $80/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in JavaScript to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Test and evaluate AI agents that navigate web interfaces, fill forms, and extract live data.\nResponsibilities:\n- Evaluate DOM tree representations, bounding box annotations, and click coordinate precision.\n- Score agent resilience against dynamic DOM updates, popups, and anti-bot obstacles.\n- Produce actionable error classifications for model post-training teams.\nRequirements:\n- Proficiency in Playwright, Puppeteer, or Selenium.\n- Deep knowledge of modern HTML, CSS, JavaScript, and accessibility trees.