DevOps Engineer- SRE

Role Overview

As a Data Annotator - SRE, you will validate root cause chains for real production alerts, confirming accuracy and fixing critical errors. You will produce ground truth labels by performing root cause analysis from scratch and provide structured feedback on annotation tasks related to incident response, debugging, and on-call workflows. You will collaborate with Research Scientists and engineers to refine annotation guidelines and identify patterns that reveal gaps in data or agent performance.

Responsibilities

• Validate root cause chains for real production alerts to confirm accuracy and flag errors.
• Perform root cause analysis from scratch to produce high-quality ground truth labels.
• Provide structured feedback on annotation tasks involving incident response and debugging.
• Collaborate with Research Scientists to shape annotation guidelines and address edge cases.
• Identify patterns across annotated incidents to improve data and agent performance.

Requirements

• 2+ years of production experience as an SRE, DevOps, or platform engineer.
• 2+ years of experience in on-call rotations.
• Strong root cause analysis instincts with the ability to interpret stack traces, metrics, and deploy histories.
• Proficiency with the modern production stack including AWS, GCP, and Kubernetes.
• Experience with observability tools such as Datadog, Grafana, or Splunk.
• Excellent technical writing skills for precise annotations.
• High level of patience and rigor for repetitive, detailed review tasks.

Nice to Have

• Experience working at high-scale companies.
• Prior experience in data labeling, evaluations, or training data workflows.
• Deep understanding of how observability tools function internally.
• Experience with post-mortem writing or incident command.

Skills

• Kubernetes
• AWS
• Datadog
• SRE
• Observability