engineering
Posted 4 hours agoSoftware Engineers: Create and Validate AI Coding Tasks
at Terac
United StatesRemote
Requirements
- WHAT WE'RE RESEARCHING We're hiring software engineers for an ongoing remote project focused on building robust evaluations for AI coding agents.
- The work involves implementing features, debugging software, configuring Docker environments, and writing automated tests.
- All work happens remotely via your own machine using standard command-line tools and GitHub.
- Candidates must be highly proficient with command-line tools and writing clean, deterministic tests.
- WHAT YOU'LL DO - Design self-contained software-engineering problems for AI agents to solve. - Build and configure development environments using Docker. - Write automated, deterministic tests to reliably grade AI performance. - Create accurate reference solutions for complex coding challenges.
- experience working as a software engineer. - Comfortable navigating unfamiliar codebases independently. - Strong proficiency with GitHub and command-line tools. - Willingness to complete a one-time skills assessment before starting.
- Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.
Benefits
- COMPENSATION $175 per task READY TO PARTICIPATE? Start your paid interview now https://terac.com/interview/start/r/0c6f1757-3003-4ee2-884f-89e3b19cd4b8?utm_source=ashby_listing_description ABOUT TERAC Terac is building the world's largest pool of vetted human experts for AI.
Contact
- Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.
Additional details
- Your expertise ensures these models can handle realistic, complex problems in a terminal environment.
- This work directly feeds into improving the accuracy and reliability of automated engineering tools.
- HOW IT WORKS You will design realistic, self-contained software-engineering problems from scratch.
- You will also create reference solutions and verify that each task can be graded reliably by our systems.
- WHO THIS IS FOR This opportunity is best suited for experienced software engineers who are comfortable navigating unfamiliar codebases.
- We welcome backend developers, full-stack engineers, DevOps specialists, and systems engineers.