Research Fellow

About the Company

Nuance Labs is building photorealistic, real-time AI avatars with emotional intelligence: a full-duplex audiovisual system that can listen, speak, react, interrupt, and respond like a real person.

Responsibilities

• Own a concrete research problem from framing through experiments, analysis, and integration into the Nuance stack
• Work on frontier Multimodal LLM systems spanning audio, video, language, and real-time interaction
• Explore and adapt modern generative modeling techniques, including flow matching, diffusion, autoregressive modeling, and hybrid approaches
• Read papers, reproduce key results, and turn promising ideas into production-grade experiments
• Design, instrument, debug, and interpret training and evaluation runs with scientific rigor
• Build evaluation harnesses, benchmarks, and analysis tooling for real-time conversational agents
• Take research-grade prototypes and turn them into systems that ship

Requirements

• Strong working knowledge of PyTorch and deep learning
• At least one first-author paper at a tier 1 venue (NeurIPS, ICML, ICLR, CVPR, etc.)
• Genuine interest in joining Nuance full-time after the fellowship
• Currently enrolled in or recently completed a BS, MS, or PhD in CS, ML, math, physics, EE, or a related field
• Strong programming ability and software engineering instincts

Preferred Qualifications

• Experience with Multimodal LLMs, omni models, or audio-language models
• Research or implementation experience with flow matching, diffusion models, or neural codecs
• Multiple tier 1 publications or significant research impact
• Olympiad medals or high-level competitive programming achievements (Codeforces grandmaster, ICPC, etc.)
• Open-source contributions to major ML frameworks

Benefits

• HSA plan with ~$2,000 in annual company contributions
• 15 days of PTO plus public holidays and a year-end office closure
• Daily lunch, drinks, and snacks
• Commuter benefits
• Visa sponsorship available (O-1, H-1B, green card)