# Machine Learning Engineer Intern (AML-Engine-Orchestration) - 2027 Start at ByteDance

> ByteDance is hiring for Machine Learning Engineer Intern (AML-Engine-Orchestration) - 2027 Start in Seattle, WA (Internship, 0-2 years experience), posted on 8 November 2026.

Canonical: https://devsunite.com/jobs/bytedance-machine-learning-engineer-intern-aml-engine-orchestration-2027-start-seattle-nov2026-e70d3a
Last updated: 2026-11-08

- **Company**: ByteDance
- **Location**: Seattle, WA
- **Employment type**: Internship
- **Experience**: 0-2 years
- **Role**: Machine Learning Engineer Intern (AML-Engine-Orchestration) - 2027 Start
- **Salary**: Competitive
- **Posted**: 2026-11-08

## Required skills

- Python
- Go
- Kubernetes
- vLLM
- Ray Serve

## Job description

### Role Overview

The Data-AML-Engine Orchestration team builds large-scale machine learning infrastructure that powers online model serving across ByteDance products, including TikTok. You will work on systems affecting GPU utilization, serving latency, infrastructure reliability, and MLE productivity.

### Responsibilities

- Design and build foundational orchestration capabilities for machine learning platforms, including **Kubernetes** Operators, container runtimes, and lifecycle management.
- Build multi-tenant resource and quota systems supporting priorities, preemption, fair sharing, elasticity, and cross-cluster scheduling. Improve **GPU** utilization and cost efficiency through resource pooling and **FinOps**.
- Build lifecycle orchestration for online model serving, including model and image distribution, deployment, upgrades, rollback, autoscaling, multi-cluster operation, and disaster recovery.
- Build serving orchestration and traffic management capabilities for disaggregated serving clusters, including topology-aware scheduling, KV Cache affinity, intelligent request routing, and QoS/SLA management.

### Requirements

- Currently pursuing a Bachelor&#x27;s or Master&#x27;s degree in Computer Science, Software Engineering, Artificial Intelligence, or related technical field.
- Proficiency in at least one of **Go**, **C++**, or **Python**, with solid foundation in data structures, algorithms, and software engineering principles.
- Familiarity with Linux and foundational understanding of operating systems, computer networks, concurrent programming, and distributed systems.
- Strong hands-on and exploratory abilities, willingness to investigate systems through source code, metrics, logs, profiling, and experiments.
- Systematic and quantitative approach to problem solving, defining measurements, testing hypotheses, and validating system improvements.
- Demonstrated ownership and collaboration through coursework, research, internships, open-source contributions, or engineering projects.

### Preferred Qualifications

- Experience with **Kubernetes**, container runtimes, resource scheduling, quota management, multi-tenant systems, or **FinOps**.
- Contributions to open-source infrastructure projects such as **Kubernetes**, Volcano, Koordinator, or OpenKruise.
- Experience with model serving systems such as **vLLM**, **SGLang**, **Triton**, **KServe**, or **Ray Serve**, or understanding of KV Cache, Continuous Batching, Prefill/Decode disaggregation, or model parallelism.
- Experience with online services, gateways, traffic management, autoscaling, performance optimization, or highly available distributed systems.
- Experience with **GPU**/**NPU** programming, heterogeneous resource scheduling, model distribution, or inference performance analysis.

## How to apply

Sign in on the job page to apply: https://devsunite.com/jobs/bytedance-machine-learning-engineer-intern-aml-engine-orchestration-2027-start-seattle-nov2026-e70d3a

## Related

- [ByteDance internships](https://devsunite.com/companies/bytedance)
- [Tech jobs in USA](https://devsunite.com/jobs-in-usa)
- [All jobs](https://devsunite.com/jobs)
