OpenAI logo for Software Engineer, Fleet Infrastructure job on DevsUnite

Software Engineer, Fleet Infrastructure

OpenAI

Actively HiringFull-time
Apply
Location

New York, NY

Experience

2-4 years

Role

Software Engineer, Fleet Infrastructure

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

As an engineer within Fleet Infrastructure, you will design, write, deploy, and operate infrastructure systems for model deployment and training on one of the world’s largest GPU fleets. The role sits at the intersection of hyperscale compute, scheduling, and storage, supporting OpenAI’s general purpose model training and deployment in a fast-moving organization.

Responsibilities

  • Design, implement, and operate compute fleet components including job scheduling, cluster management, snapshot delivery, and CI/CD systems.
  • Interface with researchers and product teams to understand workload requirements.
  • Collaborate with hardware, infrastructure, and business teams to deliver high utilization and reliability.
  • Build push-button automation for Kubernetes cluster provisioning and upgrades.
  • Ensure fast model startup via high-performance snapshot delivery across blob storage and hardware caching.

Requirements

  • Experience with hyperscale compute systems.
  • Strong programming skills.
  • Experience with public clouds, especially Azure.
  • Experience working in Kubernetes.
  • Execution-focused mentality paired with rigorous focus on user requirements.
  • Understanding of AI/ML workloads (bonus).

Required Skills

KubernetesAzureCI/CDPythonGo

Ready to apply for Software Engineer, Fleet Infrastructure?

See how you stack up at OpenAI before you apply, or go straight to the application.

Apply Anyway