AI Engineer - Optimizer
Comet
About Comet
Comet is building the development platform for teams who want to ship robust, reliable, and responsible AI applications. Opik, our open source LLM evaluation framework, has quickly become one of the most popular tools in the space. Our experiment management platform is used by data scientists at companies like Uber, Netflix, and Etsy. Tens of thousands of researchers, engineers, academics, and hobbyists use Comet every day to build the future of AI.
Working at Comet will give you access to the most exciting work being done in all areas of machine learning. Some of the top researchers and companies working on self-driving cars, drug discovery, particle research, diffusion models, and LLMs use Comet every day. Your work has the potential to accelerate the development of some of the most impactful technology in the world, and you will be doing it alongside a team of passionate, caring individuals. If that sounds exciting, Comet is the right place for you.
Comet is backed by more than $63 million in venture capital funding and powers some of the best machine-learning teams in the world, including Netflix, Uber, Etsy, and Mobileye. We are a remote-first company with offices in New York City (USA) and Tel Aviv (Israel).
You are:
We are seeking a talented AI Engineer - Optimizer to join our team and help build the next generation of Opik AI products! At the heart of this role is the Opik Agent Optimizer, a toolkit designed to automatically enhance the performance and efficiency of Large Language Model (LLM) applications. Instead of manually tweaking prompts and running evaluations, our optimizer enables automated, intelligent prompt optimization, helping developers build better, faster, and more reliable AI applications.
Ready to shape the future of AI optimization? Join us in building the most advanced agent optimization tools in the market!
This position will be located in Europe (Remote) or Israel (Hybrid).
Responsibilities:
- Research, design, and develop cutting-edge optimization techniques for LLM applications
- Build and ship AI-first product features with a focus on automatic prompt optimization and efficiency gains
- Conduct user research and interviews to deeply understand developer pain points and needs
- Perform market research to identify emerging trends, tools, and workflows in the AI ecosystem
- Collaborate with ML engineers and researchers to integrate state-of-the-art optimization and evaluation methodologies
- Contribute to building user-facing APIs and dashboards for optimization workflows
- Publish technical insights, contribute to open-source, and engage with the developer community
- Translate research findings into product features that improve developer experience and model performance
Requirements:
- Experience: 3+ years in AI/ML engineering, with a focus on optimization, model training, or applied research
- Optimization Expertise: Hands-on experience with hyperparameter tuning, AutoML, or LLM evaluation pipelines
- Model Knowledge: Deep understanding of large-scale models (GPT-5, Claude, Gemini, etc.), their limitations, and optimization opportunities
- Programming: Strong proficiency in Python, with experience in AI/ML frameworks.
- Research Mindset: Ability to design experiments, analyze results, and turn insights into actionable improvements
- Collaboration: Strong communication and teamwork skills in a fast-paced, distributed environment
- Problem Solving: Comfort with ambiguity and ability to solve complex technical and product challenges
Nice to Have:
- Open Source: Contributions to ML/AI open-source projects
- Product Sense: Experience translating research into user-facing tools or platforms
- AutoML/Optimizer Background: Familiarity with Bayesian optimization, reinforcement learning, or meta-learning techniques
- Observability & Evaluation: Knowledge of AI evaluation metrics, prompt engineering, and “LLM-as-a-Judge” systems
- Community Impact: Track record of sharing research/insights via blogs, publications, or talks
- Experience with agent optimization, including dynamic prompt adjustment and evaluation at scale
Why Join Comet?
- Play a key role in shaping the future of ML Ops and LLM Ops in one of the most exciting domains today
- Work with a talented and passionate team on cutting-edge technology
- Competitive salary, benefits, and opportunities for career growth
- A dynamic and inclusive work environment that values innovation and creativity and promotes personal development and growth
- This role will be located in Europe or Israel, working with a global team (large presence in the US, Tel Aviv and Europe), some flexibility with work hours is required
Comet is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees without regard to race, religion, color, sex, gender identity, gender expression, sexual orientation, national origin, ancestry, citizenship status, uniform service member status, marital status, pregnancy, age, medical condition, physical or mental disability, genetic information/characteristics, and any other characteristic protected by State or Federal law.
