Zoom logo for AI Engineer job on DevsUnite

AI Engineer

Zoom

Actively HiringFull-time
Apply
Location

Seattle, WA

Experience

0-3 years

Role

AI Engineer

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

Join Zoom's AI Infrastructure team to build and optimize high-performance AI inference systems serving transformer and multimodal models at scale. You will work closely with senior engineers to profile GPU workloads, identify bottlenecks limiting latency, throughput, and cost, and ship production fixes.

Responsibilities

  • Build, tune, and maintain components of Zoom's inference serving stack for transformer and multimodal models, including large and Mixture-of-Experts architectures
  • Implement and evaluate inference optimizations such as speculative decoding, continuous batching, KV cache management, parallelism layouts, and quantisation (INT4/INT8/FP8)
  • Extend and customise inference frameworks (vLLM, SGLang, TensorRT-LLM) to support new models and Zoom's production requirements
  • Profile GPU workloads with Nsight Systems, root-cause performance regressions, and validate improvements with reproducible benchmarks
  • Build internal tooling for benchmarking, performance modelling, and serving configuration
  • Partner with researchers to bring new model architectures into production efficiently
  • Contribute to on-call and production support with guidance from senior engineers

Requirements

  • A degree in Computer Science, Computer Engineering, or related field (MS or PhD preferred), or equivalent practical experience
  • 0–3 years of software engineering experience; internships, research, and open-source work in ML systems count
  • Hands-on experience with at least one inference framework (vLLM, SGLang, TensorRT-LLM, or ONNX Runtime) at the level of serving and modifying it
  • Working knowledge of how LLM inference performs on GPUs: memory bandwidth, KV cache, batching, and communication across GPUs
  • Experience profiling and debugging GPU performance, with evidence of an optimisation you measured and shipped
  • Depth in at least one of: speculative decoding, continuous batching, KV cache design, quantisation, distributed or multi-GPU serving
  • Strong programming skills in Python and C++, and comfort reading and changing large framework codebases

Required Skills

PythonC++vLLMTensorRT-LLMPyTorch

Ready to apply for AI Engineer?

See how you stack up at Zoom before you apply, or go straight to the application.

Apply Anyway