Klaviyo logo for AI Engineer II job on DevsUnite

AI Engineer II

Klaviyo

Actively HiringFull-time
Apply
Location

Boston, MA

Experience

3+ years

Role

AI Engineer II

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

Klaviyo seeks an AI Engineer to build backend systems and AI-powered product experiences for its Customer Agent platform, enabling agents to retrieve context, use tools, and act on behalf of customers at scale.

Responsibilities

  • Build and improve reliable backend systems and APIs for AI-driven customer experiences.
  • Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
  • Contribute to applied AI problems across retrieval, RAG, grounding, hallucination mitigation, model selection, and LLM vs deterministic/hybrid approaches.
  • Build and use evaluation approaches including datasets, automated/human evaluation, regression testing, error analysis, and production signals.
  • Improve system reliability via guardrails, retries, fallbacks, observability, monitoring, and thoughtful failure handling.
  • Build asynchronous and distributed processing workflows to support AI workloads at scale.
  • Participate in on-call rotation, diagnose and learn from production incidents.
  • Work with external customers and cross-functional partners to translate feedback into product improvements.
  • Monitor shipped experiences using quality metrics, performance, and customer feedback to guide iteration.

Requirements

  • You have 3+ years of professional software engineering experience, with experience building backend systems or distributed applications.
  • You have hands-on experience building or contributing to generative AI or agentic AI applications, ideally used by real users or in production environments.
  • You are proficient in Python and have experience with modern backend frameworks such as FastAPI or Django.
  • You have experience with asynchronous processing or distributed task/event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.
  • You have working knowledge of databases, data modeling, APIs, and persistence patterns used in production systems.
  • You are comfortable working in cloud environments and have experience with technologies such as AWS, containers, Kubernetes, infrastructure automation, or CI/CD systems.
  • You can reason about tradeoffs among quality, latency, cost, reliability, and implementation complexity, and know when to seek additional technical context.
  • You are comfortable working through ambiguity, breaking larger problems into smaller pieces, and making progress without every requirement being fully specified.
  • You have experience with, or strong interest in, working directly with external customers to understand problems and improve products.
  • You care about shipping useful,

Required Skills

LLMsGenerative AIPythonFastAPIDjango

Ready to apply for AI Engineer II?

See how you stack up at Klaviyo before you apply, or go straight to the application.

Apply Anyway