Role Description & Scope
Executive Role Brief & Overview
Step into a high-priority remote AI evaluation workstream built for rigorous analytical practitioners. Specialists are compensated at $55–$95/hr via direct weekly or bi-weekly settlements for all verified task submissions. As a SQL Query Optimization & Schema Design LLM Evaluator, your primary focus involves Python & Backend Engineering, synthesizing gold-standard responses, and flagging subtle model hallucinations. Work entirely on your own schedule with 24/7 cloud benchmark access and flexible weekly hour commitments. Rolling intake is currently live—complete your brief technical screening via the verified apply route to lock in your batch allocation.
- Primary Competency: Python & Backend Engineering
- Credential Tier: Vetted Domain Practitioner
- Candidate Profile: Ideal for Vetted Domain Practitioner software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
- Verified Compensation: $55 - $95 / hr
What is the role overview and compensation benchmark for this position?
- Role Scope & Domain: Verified remote contract for SQL Query Optimization & Schema Design LLM Evaluator within the Data Science & Analytics track on verified partner platforms.
- Direct Compensation: Rates range from $55 to $95 per hour (category benchmark average: $78/hr) with direct escrow disbursements.
- Work Structure: Fully remote, flexible scheduling with independent task execution.
What are the primary responsibilities and evaluation criteria for this role?
- Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
- Domain Focus: Apply specialized knowledge in SQL, LLM to identify hallucinations, logic gaps, and edge-case errors.
- Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.
Detailed Role Specifications & Project Scope
Evaluate complex SQL queries, relational schema designs, and indexing strategies.\nResponsibilities:\n- Benchmark query execution plans (EXPLAIN ANALYZE) across PostgreSQL, MySQL, and Snowflake.\n- Audit query safety against SQL injection, Cartesian products, and locking bottlenecks.\n- Design evaluation rubrics for window functions, recursive CTEs, and partitioning.\nRequirements:\n- 3+ years as Database Engineer, Data Analyst, or Backend Developer.\n- Expert command of ANSI SQL, query planners, and relational normal forms.