# Research Intern, Frontier Speculative Decoding (Winter 2027) at Together AI

> Together AI is hiring for Research Intern, Frontier Speculative Decoding (Winter 2027) in San Francisco, CA (Internship, 0-2 years experience), posted on 17 October 2026.

Canonical: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-winter-2027-san-francisco-oct2026-23189d
Last updated: 2026-10-17

- **Company**: Together AI
- **Location**: San Francisco, CA
- **Employment type**: Internship
- **Experience**: 0-2 years
- **Role**: Research Intern, Frontier Speculative Decoding (Winter 2027)
- **Salary**: Competitive
- **Posted**: 2026-10-17

## Required skills

- Python
- PyTorch
- Megatron-LM
- FSDP
- vLLM

## Job description

### Role Overview

The Speculative Decoding team at Together AI builds draft models and algorithms that enable large language models to generate faster without changing outputs. As a research intern, you will dive into open questions in speculative decoding: new drafter architectures, verification schemes, knowledge distillation, and training recipes that align draft and target models. You will train and fine-tune draft models at scale on dedicated GPU clusters and test ideas against realistic serving workloads, including long-context and agentic traffic.

### Responsibilities

- Research and prototype new efficient speculative decoding algorithms and draft model architectures
- Train, fine-tune and distill draft models, and design rigorous experiments to validate hypotheses
- Implement optimized versions for serving engines to show efficacy in real world workloads
- Communicate plans, progress, and results of projects to the broader team
- Share findings through technical write-ups and blog posts, and help bring successful ideas into production

### Requirements

- Currently pursuing a Master&#x27;s or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Hands-on experience training or fine-tuning large models with distributed training frameworks (e.g., **Megatron-LM**, **FSDP**)
- Familiarity with modern model architectures, such as Mixture-of-Experts and hybrid attention

## How to apply

Sign in on the job page to apply: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-winter-2027-san-francisco-oct2026-23189d

## Related

- [Together AI internships](https://devsunite.com/companies/together-ai)
- [Tech jobs in USA](https://devsunite.com/jobs-in-usa)
- [All jobs](https://devsunite.com/jobs)
