Klaviyo logo for Software Engineer, Conversational Products & Agent Workflows job on DevsUnite

Software Engineer, Conversational Products & Agent Workflows

Klaviyo

Actively HiringFull-time
Apply
Location

Boston, MA

Experience

3+ years

Role

Software Engineer, Conversational Products & Agent Workflows

Salary

116,000 - 174,000 $

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

Join Klaviyo's Customer Agent team to build scalable backend systems and AI-powered conversational experiences. This backend-heavy role involves owning meaningful system components, contributing to technical decisions, and developing depth across backend engineering, applied AI, and production reliability for intelligent agents that retrieve context, use tools, and take action on behalf of customers.

Responsibilities

  • Build and improve reliable backend systems and APIs powering AI-driven customer experiences.
  • Develop production agentic features involving tool use, context management, retrieval, structured outputs, orchestration, and multi-step workflows.
  • Solve applied AI problems across retrieval and RAG, grounding, hallucination mitigation, model selection, and LLM-based, deterministic, or hybrid approaches.
  • Build evaluation approaches including datasets, automated and human evaluation, regression testing, error analysis, and production signals.
  • Improve reliability through guardrails, retries, fallbacks, observability, monitoring, and failure handling.
  • Build asynchronous and distributed processing workflows supporting AI workloads at scale.
  • Participate in on-call rotation and help diagnose and mitigate production incidents.
  • Work with customers and cross-functional partners to translate feedback into product improvements.

Requirements

  • 3+ years of professional software engineering experience building backend systems or distributed applications.
  • Hands-on experience building or contributing to generative AI or agentic AI applications, ideally in production.
  • Proficient in Python with experience in modern backend frameworks such as FastAPI or Django.
  • Experience with asynchronous processing or distributed task/event systems such as Celery, Kafka, SQS, RabbitMQ, or Redis.
  • Working knowledge of databases, data modeling, APIs, and persistence patterns used in production systems.
  • Comfortable working in cloud environments with experience in AWS, containers, Kubernetes, infrastructure automation, or CI/CD systems.
  • Ability to reason about tradeoffs among quality, latency, cost, reliability, and implementation complexity.
  • Comfortable working through ambiguity and breaking larger problems into smaller pieces.
  • Experience with or strong interest in working directly with external customers.

Nice to Have

  • Experience training, fine-tuning, distilling, or adapting machine learning or language models.
  • Experience with reinforcement learning or feedback-driven optimization.
  • Experience with evaluation infrastructure such as LLM-as-judge systems or AI quality tooling.
  • Experience operating AI systems at meaningful production scale or optimizing inference.

Required Skills

PythonFastAPIAWSKubernetesRedis

Ready to apply for Software Engineer, Conversational Products & Agent Workflows?

See how you stack up at Klaviyo before you apply, or go straight to the application.

Apply Anyway