Role Description & Scope
Executive Role Brief & Overview
Shape the reasoning reliability of frontier language models through this verified independent contractor engagement. Approved contributors receive direct contractor compensation of $40–$44/hr, disbursed on a reliable weekly escrow schedule. In this Bilingual Portuguese Generalist Expert — AI Safety workstream, practitioners apply Bilingual Localization & Translation to stress-test frontier model outputs against strict scoring rubrics. Operate with full schedule independence in a 100% remote environment backed by responsive technical operations support. High-performing evaluators are onboarded daily; initiate your application through our verified referral channel for direct queue placement.
- Primary Competency: Bilingual Localization & Translation
- Credential Tier: Bachelor's
- Candidate Profile: Ideal for Bachelor's native-level bilingual linguists and cultural localization specialists with strong comparative grammar precision.
- Verified Compensation: $40 - $44 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Bilingual Portuguese Generalist Expert — AI Safety within the Language & Linguistics track on verified partner platforms.
- Direct Compensation: Rates range from $40 to $44 per hour (category benchmark average: $111/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
About the role
We're hiring proficient bilingual speakers (English & Portuguese) to help make advanced AI models safer. You'll apply your language fluency and cultural judgment to evaluate and strengthen how these models handle sensitive topics in Portuguese. No prior AI/ML experience is required — we'll train you on the workflow.
What you'll do
- Write expert-level prompts in Portuguese across a range of sensitive subject areas.
- Apply structured guidelines to classify prompts and conversations.
- Flag adversarial phrasings and escalation patterns, and document the reasoning behind your judgments.
What we're looking for
- Native or near-native fluency in Portuguese, plus business-level written English.
- A bachelor's degree, completed or in progress.
- Strong written reasoning and a high level of attention to detail.
- Sound judgment around sensitive and dual-use information.
Nice to have
- Based in Portugal or the wider Western Europe region. This is a preference, not a requirement — applicants based elsewhere are welcome.
- Experience reviewing, grading, or red-teaming written or technical content.
- Background in trust and safety, content moderation, policy evaluation, or adversarial testing.
Project Timeline
- Start date: Immediate