research
Posted Apr 22Conversational Modelling Research Engineer
at Tavus
Hybrid
Requirements
- We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems.
- AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.
- With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.
- The Role We’re looking for an AI Researcher to join our core AI team and push the boundaries of Foundation Multimodal Conversational Models.
- Neural Avatars, Talking-Heads). - Develop methods to model both verbal and non-verbal aspects of conversation, adapting and controlling avatar behavior in real time, with low-latency. - Experiment with fine-tuning, adaptation, and conditioning techniques to make AudioVisual Multimodal Models, more expressive, controllable, and task-specific. - Partner with the Applied ML team to take research from prototype to production. - Stay up to date with cutting-edge advancements — and help define what comes next.
- You’ll Be Great At This If You Have: - A PhD (or near completion) in a relevant field, or equivalent research experience. - Hands-on
- experience with Large Multimodal Models and a strong foundation in generative (language) models.
- This could be in the context of tasks such as VQA, Audio/Video understanding tasks, captioning behavioral analysis, Translation tasks, Speech to Speech systems. -
- Experience in fine-tuning/adapting VLMs for control, conditioning, or downstream tasks. - Solid background in deep learning and foundation modes. - Strong PyTorch skills and comfort building deep learning pipelines.
- Nice-to-Haves - Knowledge of large-scale model training and optimization. -
- Experience in duplex-conversational model. - Broader understanding of generative AI across modalities. - Exposure to software development best practices. - A flexible, experimental mindset i.e. comfortable working across research and engineering. - (Bonus) Publications at EMNLP, COLING, NeurIPS, ICLR, CVPR, ICCV.
Contact
- About Us Tavus https://www.tavus.io/ is a research lab pioneering human computing.
Additional details
- Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations.
- Imagine a friend who can discuss any topic with you.
- A fleet of medical assistants that can give every patient the attention they need.
- We’re a Series B company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.
- Be part of shaping a future where humans and machines truly understand each other.
- If you thrive in fast-moving startup environments, enjoy experimenting with new ideas, and love seeing your work come to life in production then you’ll feel right at home.
- Your Mission 🚀 - Conduct research on Large Multimodal Models in the context of Conversational Avatars (e.g.
- Location Preferred: San Francisco (hybrid) or London (office opening soon).
- Remote within the U.S. or Europe available for exceptional candidates.