Role Overview
Klaviyo seeks an AI Engineer to build backend systems and AI-powered product experiences for its Customer Agent platform, enabling agents to retrieve context, use tools, and act on behalf of customers at scale.
Responsibilities
- Build and improve reliable backend systems and APIs for AI-driven customer experiences.
- Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
- Contribute to applied AI problems across retrieval, RAG, grounding, hallucination mitigation, model selection, and LLM vs deterministic/hybrid approaches.
- Build and use evaluation approaches including datasets, automated/human evaluation, regression testing, error analysis, and production signals.
- Improve system reliability via guardrails, retries, fallbacks, observability, monitoring, and thoughtful failure handling.
- Build asynchronous and distributed processing workflows to support AI workloads at scale.
- Participate in on-call rotation, diagnose and learn from production incidents.
- Work with external customers and cross-functional partners to translate feedback into product improvements.
- Monitor shipped experiences using quality metrics, performance, and customer feedback to guide iteration.
Requirements
- You have 3+ years of professional software engineering experience, with experience building backend systems or distributed applications.
- You have hands-on experience building or contributing to generative AI or agentic AI applications, ideally used by real users or in production environments.
- You are proficient in Python and have experience with modern backend frameworks such as FastAPI or Django.
- You have experience with asynchronous processing or distributed task/event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.
- You have working knowledge of databases, data modeling, APIs, and persistence patterns used in production systems.
- You are comfortable working in cloud environments and have experience with technologies such as AWS, containers, Kubernetes, infrastructure automation, or CI/CD systems.
- You can reason about tradeoffs among quality, latency, cost, reliability, and implementation complexity, and know when to seek additional technical context.
- You are comfortable working through ambiguity, breaking larger problems into smaller pieces, and making progress without every requirement being fully specified.
- You have experience with, or strong interest in, working directly with external customers to understand problems and improve products.
- You care about shipping useful,