Cohere logo for Software Engineer, ML Ops job on DevsUnite

Software Engineer, ML Ops

Cohere

Actively HiringFull-time
Apply
Location

Berlin, Berlin, Germany

Experience

2-4 years

Role

Software Engineer, ML Ops

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

Cohere is a security‑first enterprise AI company building foundation models and end‑to‑end products. The Internal Infrastructure team provides the platform used to train, evaluate, and serve these models. As a Software Engineer in ML Ops, you will own the developer platform that AI researchers and ML engineers use to write, build, and debug training code.

Responsibilities

  • Run secure developer environments that accelerate research velocity.
  • Own container image build and CI/CD tooling.
  • Instrument training code and build self‑service debugging tooling.
  • Set infrastructure best practices via AI enablement, documentation, and office hours.
  • Troubleshoot production failures and performance issues, leaving the system easier to operate.
  • Build automation, infrastructure‑as‑code, and observability for a maintainable platform.

Requirements

  • Experience running a developer platform in production (CI, image builds, dev environments, internal tooling).
  • Proven ability to make ML engineers and researchers faster without sacrificing platform stability.
  • Strong Linux and Kubernetes skills; GPU cluster experience a plus.
  • Proficiency in Python or Go; preference for extending open‑source projects.
  • Experience collaborating with researchers or ML engineers with differing goals.
  • Demonstrated initiative in identifying bottlenecks and driving fixes in fast‑moving environments.

Required Skills

PythonGoKubernetesLinuxCI/CD

Ready to apply for Software Engineer, ML Ops?

See how you stack up at Cohere before you apply, or go straight to the application.

Apply Anyway