San Francisco, CA
0-2 years
Research Intern, Frontier Speculative Decoding (Winter 2027)
Competitive
The Speculative Decoding team at Together AI builds draft models and algorithms that enable large language models to generate faster without changing outputs. As a research intern, you will dive into open questions in speculative decoding: new drafter architectures, verification schemes, knowledge distillation, and training recipes that align draft and target models. You will train and fine-tune draft models at scale on dedicated GPU clusters and test ideas against realistic serving workloads, including long-context and agentic traffic.
See how you stack up at Together AI before you apply, or go straight to the application.