Role Overview
Build capabilities that enable teams to develop, deploy, and operate LLM‑powered applications.
Responsibilities
- Develop tooling and infrastructure to improve developer experience for GenAI systems.
- Design and operate services for model access, tool integration, orchestration, evaluation, observability, and runtime.
- Build scalable, reliable infrastructure on Kubernetes and collaborate across teams.
- Own projects end‑to‑end, from architecture through implementation, deployment, and operation, supporting high‑impact use cases and iterating based on feedback.
- Contribute to technical design discussions, code reviews, and standards.
Requirements
- 4+ years of professional experience in Platform Engineering, DevOps, Data Platform Engineering, MLOps, Backend Engineering, ML Engineering, or a similar role.
- Hands‑on Linux system administration experience in cloud and on‑premises environments.
- Strong engineering skills, including version control, coding best practices, debugging, testing, and production readiness.
- Hands‑on experience building or operating LLM‑powered applications, agents, or GenAI platforms in production.
- Strong platform engineering experience with Kubernetes, Helm, Argo CD, and GitOps practices.
- Experience with observability tools such as Prometheus, Grafana, Kibana, or similar.
- Proficient in Python and comfortable working with backend services and APIs.
- Experience on DevEx and paving the SDLC for users setting up applications on top of your platform.
- Good understanding of LLM application architectures, including tool calling, RAG, agent workflows, model gateways, and evaluation.
- Ability to diagnose and resolve issues related to reliability, latency, scalability, cost, and deployment of GenAI systems.
- Understanding of security, access control, data privacy, and governance for shared AI platform capabilities.
- Experimental mindset, comfortable launching early, learning from usage, and iterating quickly.
- Strong team player with good communication skills and ability to explain technical trade‑offs to different audiences.
- Comfortable collaborating with cross‑functional teams and helping define standards and best practices for building and operating GenAI systems.
Desirable Additional Qualifications
- You have experience worki