San Francisco
0-2 years
Research Intern, Frontier Speculative Decoding (Summer 2027)
Competitive
The Speculative Decoding team at Together AI builds draft models and algorithms that enable large language models to generate faster without altering outputs. As a research intern you will investigate open problems in speculative decoding—including new drafter architectures, verification schemes, knowledge distillation, and traffic‑adaptive drafters. You will train and fine‑tune draft models at scale on dedicated GPU clusters and evaluate them against realistic serving workloads such as long‑context and agentic traffic.
See how you stack up at Together AI before you apply, or go straight to the application.