Role Description & Scope
Executive Role Brief & Overview
Qualified independent professionals are invited to calibrate complex reasoning benchmarks in this remote role. Specialists are compensated at $60–$110/hr via direct weekly or bi-weekly settlements for all verified task submissions. Core deliverables for the Prompt Injection & Jailbreak Defense Evaluator role center on RLHF & LLM Rubric Evaluation, multi-step reasoning verification, and factual edge-case auditing. Built for remote autonomy, this contract lets you scale your weekly hours up or down based on batch availability. Priority onboarding slots remain open this week; apply through RemoteAIGig's verified partner link for expedited assessment routing.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $60 - $110 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Prompt Injection & Jailbreak Defense Evaluator within the AI Training track on verified partner platforms.
- Direct Compensation: Rates range from $60 to $110 per hour (category benchmark average: $73/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in LLM to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Design and test novel prompt injection vectors (direct and indirect) against AI models.\nResponsibilities:\n- Formulate jailbreak attacks using obfuscation, roleplay framing, base64, and multimodality.\n- Evaluate model robustness against system prompt extraction and goal hijacking.\n- Benchmark defensive system prompt architectures and guardrail classifiers.\nRequirements:\n- Familiarity with LLM security taxonomy (OWASP Top 10 for LLMs, MITRE ATLAS).\n- Experience in red-teaming language models or software security testing.