# Research Intern, Frontier Speculative Decoding (Summer 2027) at Together AI

> Together AI is hiring for Research Intern, Frontier Speculative Decoding (Summer 2027) in San Francisco, CA (Internship, 0-2 years experience), posted on 17 October 2026.

Canonical: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-summer-2027-san-francisco-oct2026-5909d0
Last updated: 2026-10-17

- **Company**: Together AI
- **Location**: San Francisco, CA
- **Employment type**: Internship
- **Experience**: 0-2 years
- **Role**: Research Intern, Frontier Speculative Decoding (Summer 2027)
- **Salary**: Competitive
- **Posted**: 2026-10-17

## Required skills

- PyTorch
- Megatron-LM
- FSDP
- Knowledge Distillation
- vLLM

## Job description

### Role Overview

The Speculative Decoding team at Together AI develops draft models and algorithms to accelerate large language model generation without altering outputs. As a research intern, you will explore speculative decoding research questions, including new drafter architectures, verification schemes, and adaptive drafters for evolving workloads. You will train and evaluate draft models on GPU clusters, testing against realistic serving scenarios like long-context and agentic traffic.

### Responsibilities

- Research and prototype efficient speculative decoding algorithms and draft model architectures
- Train, fine-tune, and distill draft models using distributed frameworks
- Implement optimized versions for serving engines to validate real-world efficacy
- Communicate project plans, progress, and results to the team
- Publish technical write-ups and blog posts, transitioning successful ideas to production

### Requirements

- Currently pursuing a Master&#x27;s or Ph.D. in Computer Science, Electrical Engineering, or related field
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Hands-on experience training/fine-tuning large models with distributed frameworks (e.g., Megatron-LM, FSDP)
- Familiarity with modern model architectures (Mixture-of-Experts, hybrid attention)

## How to apply

Sign in on the job page to apply: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-summer-2027-san-francisco-oct2026-5909d0

## Related

- [Together AI internships](https://devsunite.com/companies/together-ai)
- [Tech jobs in USA](https://devsunite.com/jobs-in-usa)
- [All jobs](https://devsunite.com/jobs)
