Role Description & Scope
Executive Role Brief & Overview
Contribute your subject-matter mastery to next-generation foundation model alignment in this verified remote engagement. Verified remuneration is structured at $80–$170/hr, rewarding high-precision rubric adherence and analytical depth. In this Civilian Intelligence Agency Expert – U.S. & Allied Government workstream, practitioners apply Python & Backend Engineering to stress-test frontier model outputs against strict scoring rubrics. Built for remote autonomy, this contract lets you scale your weekly hours up or down based on batch availability. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Senior
- Candidate Profile: Ideal for Senior software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $80 - $170 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Civilian Intelligence Agency Expert – U.S. & Allied Government within the Cybersecurity track on verified partner platforms.
- Direct Compensation: Rates range from $80 to $170 per hour (category benchmark average: $89/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in intelligence analysis, program management, organizational decision-making to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Title: Civilian Intelligence Agency Expert – U.S. & Allied Government
Role Type: Contractor
Location: Remote
our verified AI client is seeking current and former civilian professionals from U.S. and allied government intelligence agencies to contribute their specialized expertise to a project with a frontier AI lab. This opportunity is designed for individuals with firsthand experience working within intelligence organizations, including professionals from intelligence operations, technology, strategy, policy, program management, and senior leadership functions.
You will apply your knowledge of how intelligence agencies operate, make decisions, manage programs, and support national security missions to help train and evaluate next-generation AI systems.
Scope of Work
- Evaluate AI-generated content and scenarios involving intelligence agencies, organizational structures, operational processes, technology, and national security decision-making.
- Assess the accuracy, realism, and practical relevance of AI-generated responses based on your firsthand professional experience.
- Provide structured feedback on how intelligence organizations operate, including their responsibilities, internal workflows, coordination processes, and decision-making frameworks.
- Identify inaccuracies, unrealistic assumptions, or gaps in AI-generated materials and recommend improvements.
- Contribute to the development and review of realistic, unclassified scenarios reflecting challenges encountered by civilian intelligence professionals.
- Apply your expertise to improve AI systems' understanding of intelligence agency functions, professional responsibilities, and government operating environments.
- Communicate clear, evidence-based assessments and recommendations through written feedback.
Preferred Qualifications
- Direct professional experience as a civilian employee within a U.S. or allied government intelligence agency, such as the CIA, DIA, NSA, NGA, ODNI, NRO, MI5, MI6, GCHQ, or an equivalent allied intelligence organization.
- Experience in one or more intelligence agency functions, including:
- Intelligence operations, analysis, collection, or mission support.
- Technology, IT systems, engineering, cybersecurity, or digital transformation.
- Program management, organizational operations, or administrative leadership.
- Intelligence policy, strategic planning, governance, or interagency coordination.
- Senior management, executive leadership, or organizational decision-making.
- Strong understanding of the organizational structures, professional practices, and operating environments of civilian intelligence agencies.
- Ability to evaluate complex scenarios, identify inaccuracies, and provide clear, well-reasoned feedback.
- Excellent written English communication skills.
Learn More About Our Government & Defense Work
At our verified AI client, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.
Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.
Learn more: https://remoteaigig.com/jobs