# Research Intern, Frontier Speculative Decoding (Summer 2027) at Together AI

> Together AI is hiring for Research Intern, Frontier Speculative Decoding (Summer 2027) in San Francisco (Internship, 0-2 years experience), posted on 17 October 2026.

Canonical: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-summer-2027-san-francisco-oct2026-ee38e9
Last updated: 2026-10-17

- **Company**: Together AI
- **Location**: San Francisco
- **Employment type**: Internship
- **Experience**: 0-2 years
- **Role**: Research Intern, Frontier Speculative Decoding (Summer 2027)
- **Salary**: Competitive
- **Posted**: 2026-10-17

## Required skills

- Machine Learning
- LLMs
- Deep Learning
- speculative-decoding
- distributed-training

## Job description

### Role Overview

The Speculative Decoding team at Together AI builds draft models and algorithms that enable large language models to generate faster without altering outputs. As a research intern you will investigate open problems in speculative decoding—including new drafter architectures, verification schemes, knowledge distillation, and traffic‑adaptive drafters. You will train and fine‑tune draft models at scale on dedicated GPU clusters and evaluate them against realistic serving workloads such as long‑context and agentic traffic.

### Responsibilities

- Research and prototype efficient speculative decoding algorithms and draft model architectures.
- Train, fine‑tune, and distill draft models while designing rigorous experiments to validate hypotheses.
- Implement optimized versions for serving engines to demonstrate efficacy in real‑world workloads.
- Communicate project plans, progress, and results to the broader team.
- Share findings via technical write‑ups and blog posts and help move successful ideas into production.

### Requirements

- Currently pursuing a Master’s or Ph.D. in Computer Science, Electrical Engineering, or a related field.
- Strong knowledge of Machine Learning and Deep Learning fundamentals.
- Hands‑on experience training or fine‑tuning large models with distributed training frameworks (e.g., Megatron‑LM, FSDP).
- Familiarity with modern model architectures such as Mixture‑of‑Experts and hybrid attention.

## How to apply

Sign in on the job page to apply: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-summer-2027-san-francisco-oct2026-ee38e9

## Related

- [Together AI internships](https://devsunite.com/companies/together-ai)
- [Tech jobs in USA](https://devsunite.com/jobs-in-usa)
- [All jobs](https://devsunite.com/jobs)
