Role Description & Scope
Executive Role Brief & Overview
An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. Contractors earn $50–$90/hr with guaranteed weekly payouts and priority access to bonus calibration batches. In this Privacy Preserving & PII Redaction Benchmark Grader workstream, practitioners apply RLHF & LLM Rubric Evaluation to stress-test frontier model outputs against strict scoring rubrics. The workflow is 100% remote and asynchronous, enabling you to allocate 10 to 40 flexible hours per week from anywhere. Because cohort seats fill on a rolling basis, submit your profile early via our verified partner routing link to secure priority review.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $50 - $90 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Privacy Preserving & PII Redaction Benchmark Grader within the AI Training track on verified partner platforms.
- Direct Compensation: Rates range from $50 to $90 per hour (category benchmark average: $73/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in analytical evaluation and rubric design to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Benchmark model ability to identify, redact, and protect Personally Identifiable Information (PII).\nResponsibilities:\n- Test model responses when prompted to memorize or leak PII from training datasets.\n- Verify adherence to GDPR, CCPA, and HIPAA compliance data masking standards.\n- Grade synthetic data generation for zero leakage of real-world sensitive entities.\nRequirements:\n- Familiarity with privacy regulations (GDPR, HIPAA) and data protection principles.\n- High ethical standards and rigorous verification methods.