Role Overview
Join a talent‑dense backend team building an AI operating system for enterprise IT. You’ll own critical platform components—including large‑scale batch job infrastructure, an LLM gateway for token throughput and provider failover, and enterprise‑grade auth/observability defaults. The role focuses on solving foundational, end‑to‑end problems across millions of lines of customer code, real‑time LLM workloads, and multi‑tenant security.
Responsibilities
- Design and build core backend platform components that enable rapid engineering delivery.
- Develop and scale batch job infrastructure handling massive data volumes and complex processing.
- Engineer the LLM gateway, managing token throughput, provider failover, and quota across models and providers.
- Establish robust auth and observability defaults to meet stringent enterprise reliability and security standards.
- Build internal tooling and APIs that measurably accelerate product development and team efficiency.
Requirements
- 3+ years of backend engineering experience with significant ownership of platform or infrastructure components, ideally from MVP to scale‑up.
- Proven experience designing and implementing distributed systems, including queueing and large‑scale batch processing in production.
- Familiarity with LLM infrastructure at scale, covering token routing, provider failover, and real‑time vs. async patterns.
- Track record of building internal tooling or APIs that significantly improved team velocity; reliability, observability, and multi‑tenant security are first‑class concerns.
- Ability to work in person with the team in London five days a week.