About the Opportunity

This opportunity is for experienced Senior Software Engineers with expertise in software development, algorithms, data structures, debugging, codebase refactoring, performance optimization, and modern programming languages to contribute to advanced AI training and evaluation projects.

You'll apply your software engineering expertise to create Reinforcement Learning (RL) environments that test AI models on realistic software engineering workflows, including DevOps, CI/CD, debugging, code optimization, and command-line development workflows.

You'll design reproducible environments, develop golden reference solutions, and create challenging engineering tasks that evaluate an AI model's ability to reason through complex software problems.

No prior AI experience is required. Your software engineering expertise and technical problem-solving skills are the primary qualifications for success in this role.

Responsibilities

• Design and develop Reinforcement Learning environments that evaluate AI models on realistic software engineering workflows.
• Create technical tasks involving debugging, feature implementation, code refactoring, performance optimization, and DevOps workflows.
• Build reproducible environments using tools such as Git, Docker, GDB, AddressSanitizer (ASan), FFmpeg, and other CLI tools.
• Develop and validate golden reference solutions for software engineering evaluation tasks.
• Apply expertise in algorithms, data structures, debugging, and performance tuning to create challenging technical scenarios.
• Evaluate AI-generated solutions for correctness, maintainability, performance, and robustness.
• Identify bugs, edge cases, implementation failures, and performance bottlenecks.
• Collaborate with technical teams to refine task specifications, evaluation criteria, and engineering workflows.
• Maintain high standards for reproducibility, technical accuracy, and evaluation quality.

Required Qualifications

• Strong proficiency in one or more of C++, Python, Java, Go, TypeScript, or Rust.
• Deep understanding of algorithms, data structures, software architecture, and performance optimization.
• Demonstrated experience debugging complex software issues and delivering maintainable solutions.
• Strong background in feature development, codebase refactoring, and software optimization.
• Experience working with development tools, command-line environments, and software engineering workflows.
• Excellent analytical, problem-solving, written, and verbal communication skills.
• Strong attention to detail and ability to work effectively in remote, cross-functional teams.

Preferred Qualifications

• Experience working with large-scale or distributed codebases.
• Familiarity with DevOps, CI/CD, containerization, and production software environments.
• Experience with tools such as Git, Docker, GDB, ASan, FFmpeg, or similar developer tooling.
• Familiarity with AI, machine learning, reinforcement learning, or AI model evaluation.
• Experience participating in rigorous code reviews and software engineering quality initiatives.
• Background in developing technical benchmarks, evaluation frameworks, or reproducible engineering environments.

Compensation