Home > Jobs > Software Engineering > Codeforces Problem Setter
✓ Verified Software Engineering 🔥 High Volume

Codeforces Problem Setter

Compensation $45 - $65 / hr
Location Remote
Available Openings 50+ openings
TIER 4/5 Domain Expert Screen
Verified Skill Badge
Interview Format 20-min AI Technical Probe + Coding
Insider Preparation Tip Zara AI probes specific tech stacks listed on your CV. Walk through your real architectural trade-offs aloud.

Key Skills & Domain Expertise

Basics C++ C++ Competitive Programming CodeForces Handle Open Source Contributions
SPONSORED (728x90) Accelerate your AI benchmarks: Explore verified developer tooling & APIs

Role Description & Scope

Executive Role Brief & Overview

An active model-alignment batch is currently seeking domain-vetted remote contributors for this role. Verified remuneration is structured at $45–$65/hr, rewarding high-precision rubric adherence and analytical depth. Contributors in the Codeforces Problem Setter role leverage Python & Backend Engineering to benchmark model performance across high-difficulty domain scenarios. Work entirely on your own schedule with 24/7 cloud benchmark access and flexible weekly hour commitments. Client calibration batches are actively reviewing applicants—use the verified partner portal link to fast-track your credential screening.

  • Primary Competency: Python & Backend Engineering
  • Credential Tier: Vetted Domain Practitioner
  • Candidate Profile: Ideal for Vetted Domain Practitioner software engineers and systems developers skilled in production code review, debugging, and algorithmic synthesis.
  • Verified Compensation: $45 - $65 / hr

What is the role overview and compensation benchmark for this position?

  • Role Scope & Domain: Verified remote contract for Codeforces Problem Setter within the Software Engineering track on verified partner platforms.
  • Direct Compensation: Rates range from $45 to $65 per hour (category benchmark average: $80/hr) with direct escrow disbursements.
  • Work Structure: Fully remote, flexible scheduling with independent task execution.

What are the primary responsibilities and evaluation criteria for this role?

  • Core Evaluation Tasks: Review and benchmark generative AI completions for factual accuracy, reasoning integrity, and compliance with project rubrics.
  • Domain Focus: Apply specialized knowledge in Basics C++, C++, Competitive Programming to identify hallucinations, logic gaps, and edge-case errors.
  • Grading Standards: Calibrate outputs against structured rubric criteria and maintain high inter-annotator agreement on partner evaluation batches.

Detailed Role Specifications & Project Scope

Job Title:Codeforces Problem Setter

Job Type: Contractor (15hrs+ a week)

Location: Remote

Opportunity Snapshot

Pay: $30 - $100

Commitment: 15+ hours per week

Location: Fully remote

You’ll need: Strong competitive programming background and advanced C++

Your tasks: Create original competitive programming problems with reference solutions and robust test suites

You’ll create Reinforcement Learning Environments that test a model’s ability to solve hard algorithmic problems. Each task means writing an original problem that doesn’t exist on any online judge, a correct reference solution, and a test suite strong enough that a wrong solution fails.

What you’ll do

  1. Design original competitive programming problems, absent from Codeforces, AtCoder, and all other judges.
  2. Write a correct reference solution and verify it against the constraints.
  3. Build a robust test suite: edge cases, maximum constraints, and tests that break plausible wrong approaches.
  4. Implement checkers for problems with multiple valid outputs.
  5. Document the problem’s intended solution, complexity, and the reasoning behind your test cases.
  6. Review problems from other contributors for correctness and test coverage.
  7. Flag problems that turn out to be ambiguous or have unintended solutions.

What we’re looking for

  1. Strong competitive programming record — Codeforces, AtCoder, ICPC, IOI, or equivalent.
  2. Advanced C++ for reference solutions and checkers.
  3. Deep algorithmic knowledge and the ability to reason about constraints, complexity, and edge cases.
  4. Meticulous attention to detail in validation and output consistency.
  5. Clear written and verbal English for documenting problems and edge cases.
  6. Comfortable working independently and meeting deadlines.
  7. Prior experience as a problem setter, tester, or checker on a major platform is a strong plus.

Compensation Structure

Compensation is output-based; experts are paid per task that meets the project specifications. The time required may vary depending on your experience and workflow. Minimum submission requirements apply.

Start Timeline & Availability

We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24–48 hours of completing onboarding.

How the selection process works

  1. Apply and complete the screening questions
  2. Complete the AI interview for this role — it’s how your expertise gets in front of the client
  3. Profile review
  4. Onboarding — our Talent Ops team will get you set up
ROLE REALITY CHECK Code Hallucination & Edge-Case Test Suites • Strict Spec

Field Inspection & Rubric Realities

1. Technical Task Profile

Daily engineering batches for Codeforces Problem Setter center on Basics C++, C++, Competitive Programming, CodeForces Handle. Practitioners author reproducible bug-fix prompts, verify edge-case unit test suites, and flag hallucinated API imports or subtle concurrency regressions across multi-step reasoning traces. Submissions are benchmarked against a deterministic golden set during rubric calibration to preserve high inter-annotator agreement (tracked via Cohen's kappa) alongside multimodal S2S audio latency and barge-in interruption checks on voice-assisted coding agents.

2. Screening Pitfalls

Automated intake for Tier 4/5 (Domain Expert Screen — 20-min AI Technical Probe + Coding) enforces deterministic halting criteria. During Micro1 Zara automated technical interviews, candidates are flagged if spoken or coded explanations stall beyond the S2S audio latency window, or if barge-in interruption recovery fails during live follow-up probes. On Mercor and partner asynchronous video screens, recording constraints require concise, evidence-backed walkthroughs without reading off external scripts. Across written rubric calibration gates, the #1 disqualification trigger is missing a P0 factual or spec error on a seeded golden set item, which immediately drops your Cohen's kappa and inter-annotator agreement score below cohort onboarding thresholds.

3. Benchmark Verification

Cross-referencing 77 verified active Software Engineering contracts in our local index shows hourly compensation spanning $8/hr to $800000/hr. At $45 - $65 / hr, this Codeforces Problem Setter contract is positioned as a high-volume entry allocation relative to the $95/hr category median. It carries a Vetting Tier 4/5 (Domain Expert Screen) classification, meaning applicants who maintain consistent inter-annotator agreement on the initial golden set and respect all halting criteria during rubric calibration qualify for weekly escrow payouts and priority batch allocation.

SOFTWARE ENGINEERING • PRE-SCREEN CHECK 0 / 3 Answered

Pre-Screen Readiness Check

Quick 3-step pre-screen check: Test your instincts against real partner grading rules for this specific role before launching the official application.

SKILL CHECK: BASICS C++ True / False • Memory Safety Gate

1. C++ RAII & Undefined Behavior on Dangling References

True or False: In modern C++ (C++17/20), returning a std::string_view constructed from a temporary local std::string created inside a function is safe because string_view automatically manages buffer lifetime.

SKILL CHECK: PYTHON Multiple Choice • Hallucination Audit

2. Python Standard Library vs. Hallucinated Methods

When reviewing Python code generated for JSON schema validation, Model A invokes json.validate_strict(data, schema). What is the correct auditor determination?

SKILL CHECK: MICRO1 INTERVIEW Single-Choice • Micro1 Screening Protocol

3. Micro1 Automated Voice & Technical Screen

This role routes through an automated Micro1 technical screen. How should you pace your spoken explanations and live problem-solving to pass the automated evaluation gate?