Role Description & Scope
Executive Role Brief & Overview
Join a high-impact reinforcement learning and benchmark evaluation program designed for experienced practitioners. Practitioners command $60–$80/hr with transparent time-and-task tracking and rapid weekly escrow payouts. In this Federal Management & Program Analyst workstream, practitioners apply RLHF & LLM Rubric Evaluation to stress-test frontier model outputs against strict scoring rubrics. Built for remote autonomy, this contract lets you scale your weekly hours up or down based on batch availability. Priority onboarding slots remain open this week; apply through RemoteAIGig's verified partner link for expedited assessment routing.
- Primary Competency: RLHF & LLM Rubric Evaluation
- Credential Tier: Senior
- Candidate Profile: Ideal for Senior analytical evaluators experienced in structured rubric scoring, prompt stress-testing, and hallucination auditing.
- Verified Compensation: $60 - $80 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for Federal Management & Program Analyst within the Business Operations track on verified partner platforms.
- Direct Compensation: Rates range from $60 to $80 per hour (category benchmark average: $70/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in federal program management, policy analysis, decision memo writing to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Role Title: Federal Management & Program Analyst
Role Type: Contractor
Location: Remote, US only
our verified AI client is engaging Federal Management & Program Analysts to contribute their subject-matter expertise to a customer-driven AI evaluation project focused on the intricacies of federal program management and policy analysis. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Develop and submit realistic federal management, program, and policy scenarios that reflect authentic agency workflows.
- Create clear, accurate reference answers and documentation for use in AI training.
- Review, evaluate, and provide expert feedback on scenarios and deliverables produced by other contributors.
- Validate that all project materials align with actual federal planning, evaluation, and reporting practices.
- Leverage your background in policy analysis, decision memo writing, and preparation of executive briefings or after-action reports.
- Collaborate asynchronously and communicate effectively to ensure clarity and consistency in project deliverables.
Preferred Qualifications
- Current or prior experience in federal program, policy, or operational planning (such as OPM series GS-0343, GS-0301, or equivalent roles).
- Demonstrated expertise in writing decision memos, program evaluations, briefings, or after-action reports for senior leaders.
- Exceptional written and verbal communication skills, with attention to detail and clarity.
- US-based contributor possessing in-depth knowledge of federal government processes.
- Experience with performance measurement, program evaluation, or strategic planning in government settings (nice to have).
- Background supporting headquarters, program offices, or planning staff within federal agencies (nice to have).