Role Overview
As an engineer within Fleet Infrastructure, you will design, write, deploy, and operate infrastructure systems for model deployment and training on one of the world’s largest GPU fleets. The role sits at the intersection of hyperscale compute, scheduling, and storage, supporting OpenAI’s general purpose model training and deployment in a fast-moving organization.
Responsibilities
- Design, implement, and operate compute fleet components including job scheduling, cluster management, snapshot delivery, and CI/CD systems.
- Interface with researchers and product teams to understand workload requirements.
- Collaborate with hardware, infrastructure, and business teams to deliver high utilization and reliability.
- Build push-button automation for Kubernetes cluster provisioning and upgrades.
- Ensure fast model startup via high-performance snapshot delivery across blob storage and hardware caching.
Requirements
- Experience with hyperscale compute systems.
- Strong programming skills.
- Experience with public clouds, especially Azure.
- Experience working in Kubernetes.
- Execution-focused mentality paired with rigorous focus on user requirements.
- Understanding of AI/ML workloads (bonus).