Role Overview
You will own the complete AI backend end-to-end - from agent architecture and model integration to deployment, monitoring, and continuous improvement. You are the single owner of the AI stack: designing agents, building retrieval pipelines, optimizing costs, deploying to production, and iterating based on real-world usage. This role sits at the intersection of AI engineering, backend engineering, and DevOps.
Responsibilities
- Design and scale a multi-agent orchestration system with 10+ specialized agents
- Implement parallel execution, conditional routing, and shared state handling
- Manage multi-model, multi-provider architecture and optimize token usage
- Build hybrid search pipelines using vector databases and keyword search
- Develop scalable backend services for AI pipelines with streaming responses
- Deploy and manage services using cloud infrastructure and maintain CI/CD pipelines
- Build monitoring systems for latency, errors, and model performance
- Optimize inference costs across models and workflows
Requirements
- Strong experience with backend development (Python preferred)
- Hands-on experience with LLMs and AI systems in production
- Experience with vector databases and retrieval systems
- Understanding of distributed systems and async processing
- Familiarity with cloud platforms (AWS/GCP/Azure)
- 4+ Years of experience
Skills
- Python
- LLMs
- AWS
- Vector Databases
- DevOps
Nice to Have
- Experience with multi-agent frameworks
- Knowledge of prompt engineering at scale
- Experience with real-time AI applications
- Exposure to monitoring and observability tools
Benefits
- Flexible schedule
- Food provided
- Paid sick time
- Provident Fund