Job Description

We are hiring skilled software engineers (or DevOps/SysAdmins/etc.) with strong command-line and systems expertise. The ideal candidate is comfortable working in Unix-like environments, proficient with containerized workflows, and experienced in creating reliable, reproducible setups supported by clear documentation and testing.

Why Apply

• Innovation Impact: Contribute to pioneering AI research with a top startup dedicated to advanced technology solutions.

• Flexible Engagement: Work remotely with adaptable hours, allowing you to balance your professional expertise with other commitments.

Responsibilities

Your goal will be to create novel CLI tasks for evaluating AI Agents performance, including creation of the task, the test suite, and the solution. You will be using terminal-bench.

• Design multi-step command-line development exercises (e.g., debugging, refactoring, data processing, build automation).

• Develop deterministic test suites and solutions.

• Containerize tasks with Docker to ensure consistency and reproducibility.

• Write clear, detailed documentation to describe objectives and requirements.

Required Qualifications

• Proficiency with Linux/Unix command-line tools and Bash scripting.

• 1+ years of professional software engineering experience.

• Experience with Docker and containerized development environments.

Preferred Qualifications

• Familiarity with build tools (Make, CMake, npm, Cargo, Gradle, etc.).

• Experience troubleshooting CI/CD pipelines or development environments.

• Exposure to multiple language ecosystems (Python, Go, Rust, C/C++).

Pay Rate

• $10 Per Accepted Task (Roughly 1 hour of work)

• If you're working 20 hours / week you can make up to $800 / mo (INR Rs. 64,000) part-time, while helping improve AI models!