# Research Intern, Frontier Speculative Decoding (Winter 2027) at Together AI

> Together AI is hiring for Research Intern, Frontier Speculative Decoding (Winter 2027) in San Francisco (Internship, 0-2 years experience), posted on 17 October 2026.

Canonical: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-winter-2027-san-francisco-oct2026-0ecc8e
Last updated: 2026-10-17

- **Company**: Together AI
- **Location**: San Francisco
- **Employment type**: Internship
- **Experience**: 0-2 years
- **Role**: Research Intern, Frontier Speculative Decoding (Winter 2027)
- **Salary**: Competitive
- **Posted**: 2026-10-17

## Required skills

- Machine Learning
- LLMs
- Deep Learning
- Megatron-LM
- FSDP

## Job description

### Role Overview

The Speculative Decoding team at Together AI develops draft models and algorithms to accelerate large language model generation. As a research intern, you&#x27;ll explore speculative decoding research questions, train and fine-tune draft models on GPU clusters, and test ideas against realistic serving workloads including long-context and agentic traffic.

### Responsibilities

- Research and prototype new speculative decoding algorithms and draft model architectures
- Train, fine-tune, and distill draft models; design experiments to validate hypotheses
- Implement optimized versions for serving engines to demonstrate real-world efficacy
- Communicate project plans, progress, and results to the team
- Share findings through technical write-ups and blog posts, transitioning successful ideas to production

### Requirements

- Currently pursuing a Master&#x27;s or Ph.D. in Computer Science, Electrical Engineering, or related field
- Strong knowledge of Machine Learning and Deep Learning fundamentals
- Hands-on experience training/fine-tuning large models with distributed frameworks (e.g., Megatron-LM, FSDP)
- Familiarity with modern architectures like Mixture-of-Experts and hybrid attention

## How to apply

Sign in on the job page to apply: https://devsunite.com/jobs/together-ai-research-intern-frontier-speculative-decoding-winter-2027-san-francisco-oct2026-0ecc8e

## Related

- [Together AI internships](https://devsunite.com/companies/together-ai)
- [Tech jobs in USA](https://devsunite.com/jobs-in-usa)
- [All jobs](https://devsunite.com/jobs)
