Role Description & Scope
Executive Role Brief & Overview
An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. The contract features transparent hourly remuneration at $80–$170/hr with zero platform commission deductions. The Intelligence Operations & Collection Expert assignment demands rigorous RLHF & LLM Rubric Evaluation to author complex prompts and evaluate chain-of-thought reasoning. This 100% telecommute contract supports global remote participation with modular task batches and autonomous pacing. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $80 - $170 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Intelligence Operations & Collection Expert within the Finance & Accounting track on verified partner platforms.
- Direct Compensation: Rates range from $80 to $170 per hour (category benchmark average: $104/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in intelligence operations, intelligence collection, humint to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Title: Intelligence Operations & Collection Expert
Role Type: Contractor
Location: Remote
our verified AI client is seeking experienced Intelligence Operations & Collection Experts to contribute their specialized knowledge to an AI training and evaluation project focused on intelligence operations and national security.
We are particularly interested in professionals with current or previous experience within civilian intelligence agencies, such as the CIA, NSA, MI6/SIS, GCHQ, or equivalent organizations.
Scope of Work
- Evaluate AI-generated scenarios involving intelligence collection, operational planning, and national security decision-making.
- Assess the accuracy, realism, and relevance of intelligence collection methodologies and operational processes.
- Review and refine intelligence-related case studies, analytical summaries, and scenario-based materials.
- Identify gaps, inconsistencies, and unrealistic assumptions in AI-generated content.
- Provide structured feedback to improve AI reasoning and understanding of intelligence operations.
Preferred Qualifications
- Current or previous professional experience within a civilian intelligence agency, particularly in intelligence operations, collection, or collection management.
- Demonstrated expertise in HUMINT, SIGINT, OSINT, or other intelligence collection disciplines.
- Understanding of civilian intelligence agency procedures, operational frameworks, legal authorities, and interagency coordination.
- Experience in operational planning, intelligence collection requirements, or evaluating intelligence information.
- Strong analytical judgment, attention to detail, and written communication skills.
Learn More About Our Government & Defense Work
At our verified AI client, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.
Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.
Learn more: https://remoteaigig.com/jobs