hero
companies
Jobs

Senior ML Research Scientist, Pegasus

Twelve Labs

Twelve Labs

Software Engineering, Data Science
Seoul, South Korea
Posted on Apr 10, 2026

Location

Seoul, South Korea

Employment Type

Full time

Location Type

Hybrid

Department

Research ScienceResearch Science

Who we are

At TwelveLabs, we are pioneering the development of cutting-edge multimodal foundation models that have the ability to comprehend videos just like humans do. Our models have redefined the standards in video-language modeling, empowering us with more intuitive and far-reaching capabilities, and fundamentally transforming the way we interact with and analyze various forms of media.

With a $110+ million in Seed and Series A funding, our company is backed by top-tier venture capital firms such as NVIDIA’s NVentures, NEA, Radical Ventures, and Index Ventures, and prominent AI visionaries and founders such as Fei-Fei Li, Silvio Savarese, Alexandr Wang and more. Headquartered in San Francisco, with an influential APAC presence in Seoul, our global footprint underscores our commitment to driving worldwide innovation.

Our partnership with NVIDIA and AWS gives us access to the most advanced chips, including B300s, enabling us to push the boundaries of what's possible in video AI.

We are a global company that values the uniqueness of each person’s journey. It is the differences in our cultural, educational, and life experiences that allow us to constantly challenge the status quo. We are looking for individuals who are motivated by our mission and eager to make an impact as we push the bounds of technology to transform the world. Join us as we revolutionize video understanding and multimodal AI.

About the Team

The Pegasus team sits at the core of TwelveLabs' video understanding capabilities and is responsible for driving Pegasus, our Video Analysis product. Our focus is on developing multimodal video analysis systems that are designed for high instruction following capability and producing highly complex, hierarchically structured outputs. We focus on shipping products with real-world value rather than doing research in isolation, and we work in a goal-oriented, cross-functional team that encompasses both ML researchers and engineers.

Our work covers a broad range of challenges: large-scale distributed training of multi-modal LLMs that span from pre-training to RL, accurate temporal segmentation and structured metadata extraction for real-world use cases, extending temporal context length to multiple hours, and data curation processes that enable well-aligned evaluation and performance improvements through training data enhancements.

Our team has access to the most advanced chips in the world, including NVIDIA B300s, to push the boundaries of video analysis systems—accelerating our research-to-production cycle as fast as possible.

In this role, you will

  • Drive research on Pegasus's harder problems such as temporal segmentation, multi-hour context, structured output generation, and training strategies from pre-training through RL, where the right approach requires deep judgment.

  • Design rigorous experiments and evaluation methods that produce clear signals on complex multimodal problems, including where ground truth is ambiguous.

  • Strengthen the team's research approach by helping reframe problems, sharpen hypotheses, and raise the bar for experimental rigor.

  • Work closely with ML Engineers to translate research advances into production, informing tradeoffs around architecture, serving, and system design.

  • Communicate research findings clearly and use them to inform technical direction across the team.

  • Explore and adopt AI-assisted development tools such as Claude, Gemini, and GPT to improve productivity across coding, experimentation, debugging, and documentation.

Even if you don't check every box, we encourage you to apply.

If you're a zero-to-one achiever, a ferocious learner, and a kind team player who motivates others, you'll find a home at TwelveLabs.

You may be a good fit if you have

  • Significant research experience in one or more areas relevant to video understanding, such as multimodal LLMs, large-scale distributed training, temporal modeling, data-centric model development, computer vision, or vision-language systems, with demonstrated depth in at least one.

  • A track record of driving research on problems with significant technical ambiguity, demonstrated through projects, publications, or technical contributions.

  • Strong proficiency in Python and PyTorch.

  • Exceptional experimental judgment, including the ability to design evaluations for complex multimodal problems, run rigorous ablations, and draw clear conclusions from empirical results.

  • Strong communication skills and a track record of strengthening others' research through collaboration — helping formulate sharper hypotheses, identify more informative experiments, or reframe problems more tractably.

Preferred qualifications

  • Experience working on multimodal systems involving video, vision, language, or structured output generation.

  • Experience improving model quality through data curation, evaluation design, or training data enhancements.

  • Experience with large-scale distributed training in high-performance GPU environments.

  • Experience translating research advances into production ML systems.

  • Experience defining research direction within a team or project.

  • MS, PhD, or equivalent practical experience in Machine Learning, Computer Science, or a related technical field.

Others

  • Work Location: Seoul Itaewon office + Pangyo satellite office

  • Additional Info: 전문연구요원 편입/전직 가능합니다.

Hiring Process

Application Review → Recruiter Interview (비대면/30분) → Loop Interview [Hiring Manager Interview&Live Coding Test Interview] (대면/약 90분) → Loop Interview [System Design&Final Round Interview] (대면/약 120분) → Reference Check → Offer

Benefits and Perks

  • 글로벌 B2B 고객과 함께 성장하는 Global Team

  • 자율성과 협업을 모두 갖춘 하이브리드 근무

  • 전 직원에게 맥북 및 70만 원 상당 재택근무 장비 지원, 3년 주기로 최신 장비 교체

  • 식사·교통비 등 자유롭게 사용할 수 있는 월 60만 원 한도 법인카드 제공

  • 사무실 내 스낵바(간식, 커피, 신선식품 제공)

  • 연말 2주간 겨울방학 운영

  • 연 1회 건강검진 지원

  • 영어교육 프로그램 지원