Machine Learning Engineer, Inference System
Twelve Labs
This job is no longer accepting applications
See open jobs at Twelve Labs.See open jobs similar to "Machine Learning Engineer, Inference System" Techstars.Software Engineering
San Francisco, CA, USA
Posted on Tuesday, June 13, 2023
Who we are
At Twelve Labs, we are pioneering the development of cutting-edge multimodal foundation models that have the ability to comprehend videos just like humans do. Our models have redefined the standards in video-language modeling, empowering us with more intuitive and far-reaching capabilities, and fundamentally transforming the way we interact with and analyze various forms of media.
With a remarkable $77 million in Seed and Series A funding, our company is backed by top-tier venture capital firms such as NVIDIA’s NVentures, NEA, Radical Ventures, and Index Ventures, and prominent AI visionaries and founders such as Fei-Fei Li, Silvio Savarese, Alexandr Wang and more. Headquartered in San Francisco, with an influential APAC presence in Seoul, our global footprint underscores our commitment to driving worldwide innovation.
We are a global company that values the uniqueness of each person’s journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.
About the role
As a Software Engineer, Inference Infrastructure at Twelve Labs, you will play a crucial role in the ML Platform team, where your primary focus will be scaling the infrastructure to host one of the industry's most powerful video foundation models. Your responsibility will be to ensure the scalability, performance, and reliability of our model inference pipeline, which involves handling high volumes of traffic, video processing, and model deployment.
In this role, you will
- Develop an end-to-end video processing pipeline that processes multimodal data (images, audio, etc.) in a video to fit the required format for models.
- Deploy ML models, ensuring consistent and optimal performance in both cloud (like AWS, Azure, GCP) and on-premise environments.
- Collaborate closely with DevOps and system engineering teams to ensure seamless deployments, rollbacks, and updates.
- Engage in troubleshooting and quick resolution of any deployment-related issues, ensuring minimal downtime and optimal user experience.
You may be a good fit if you have
- Proficiency in Python and Go
- 3 years + experience in building and designing ML infrastructure.
- 5 years + software development experience, including experience in building ML infrastructure.
- Strong understanding of container ecosystems such as Docker and Kubernetes.
- Experience in deploying AI/ML models on cloud platforms such as AWS, Azure, GCP.
- Ability to communicate effectively in English with individuals from diverse language backgrounds and different timezones
Desired experience
- MS or PhD in Computer Science, Math, or equivalent real-world experience
- Experience in leading a team of engineers
- Experience in training deep learning models
- Experience in model deployment using Triton and TensorRT
- Proficiency in GPU Computing (i.e. CUDA)
Interview and Onboarding Process
Recruiter Phone Screen -> Hiring Manager Call -> Technical Interview and/or Take Home Assignment -> Culture Interview -> Reference Checks
We're also excited to share that we'll do global onboarding in Seoul for all new hires (company-sponsored travel).
Even if there are a few checkboxes that aren’t ticked through your prior experience, we still encourage you to apply! If you are a 0-to-1 achiever, a ferocious learner, and a kind and fun team player who motivates others, you will find a home at Twelve Labs.
We welcome applicants from all walks of life and are committed to equal-opportunity employment. We cherish and celebrate diversity not just because it is the right thing to do, but because it makes our company much stronger.
Benefits and Perks
🤝 An open and inclusive culture and work environment.
🧑💻 Work closely with a collaborative, mission-driven team on cutting-edge AI technology.
🦷 Full health, dental, and vision benefits
✈️ Extremely flexible PTO and parental leave policy. Office closed the week of Christmas and New Years.
🏙 Remote-flexible, offices in San Francisco and Seoul and coworking stipend
🛂 VISA support (such as H1B and OPT transfer for US employees)
This job is no longer accepting applications
See open jobs at Twelve Labs.See open jobs similar to "Machine Learning Engineer, Inference System" Techstars.