# SDE2 - API Platform at Sarvam

> Sarvam is hiring for SDE2 - API Platform in Bengaluru (Full-time, 3+ years experience), posted on 29 October 2026.

Canonical: https://devsunite.com/jobs/sarvam-sde2-api-platform-bengaluru-oct2026-5c5b39
Last updated: 2026-10-29

- **Company**: Sarvam
- **Location**: Bengaluru
- **Employment type**: Full-time
- **Experience**: 3+ years
- **Role**: SDE2 - API Platform
- **Salary**: Competitive
- **Posted**: 2026-10-29

## Required skills

- LLMs
- Python
- FastAPI
- PostgreSQL
- Redis

## Job description

### Role Overview

Sarvam&#x27;s API platform team seeks an SDE2 to build and evolve the LLM API platform, handling routing, streaming, reliability, and performance.

### Responsibilities

- Build and evolve the LLM API platform from edge request to response.
- Lead the Python→Go rewrite while maintaining reliability.
- Implement streaming infrastructure (SSE, long-lived connections, cancellation handling).
- Design routing and failover with weighted provider chains, retries, latency-driven admission control.
- Ensure OpenAI spec compatibility across inference servers (vLLM, SGLang, Dynamo).
- Build metering, billing, and rate-limiting for the commercial layer.
- Deliver performance and reliability for multi-tenant, long-context agentic workloads.
- Implement observability (logging, metrics, tracing) for production debugging.
- Develop integration and load testing harness for fast, safe releases.
- Collaborate with Inference and MLOps teams on production readiness for new models.
- Uphold design-first, documentation-first culture (RFCs, written decisions).

### Requirements

- 3+ years building production backend systems.
- Strong Python in production: asyncio, FastAPI or similar, experience under real load.
- Working knowledge of Go or strong willingness to learn; work in both languages during rewrite.
- Experience building low-latency, multi-tenant backend services.
- Hands-on experience with streaming systems: SSE or WebSockets, long-lived connections, backpressure.
- Strong PostgreSQL and Redis fundamentals: schema design, query performance, caching, rate limiting.
- Comfort running services on Kubernetes in production.
- Ownership mindset: test before shipping, debug production with metrics/logs/traces, write RCAs.

## How to apply

Sign in on the job page to apply: https://devsunite.com/jobs/sarvam-sde2-api-platform-bengaluru-oct2026-5c5b39

## Related

- [Sarvam jobs and internships](https://devsunite.com/companies/sarvam)
- [Python Developer Jobs in Bangalore](https://devsunite.com/python-developer-jobs-in-bangalore)
- [Backend Developer Jobs in Bangalore](https://devsunite.com/backend-developer-jobs-in-bangalore)
- [Python Developer Jobs](https://devsunite.com/python-developer-jobs)
- [Backend Developer Jobs](https://devsunite.com/backend-developer-jobs)
- [Tech jobs in Bangalore](https://devsunite.com/jobs-in-bangalore)
- [All jobs](https://devsunite.com/jobs)
