Role Overview
As a Cloud Native Data Engineer, you design and implement robust data pipelines and containerized analytics platforms using open-source tools like Apache Airflow, Kafka, Spark, and Trino. You automate deployments with Kubernetes, Helm, and CI/CD, integrate platforms into customer landscapes, and translate business requirements into data products. You also continuously update cloud, data, and software engineering knowledge, sharing insights with the team and clients.
Responsibilities
- Build data pipelines with Apache Airflow, Kafka, Spark, Trino ensuring reliable, performant data flow.
- Develop containerized analytics platforms and CI/CD pipelines on Kubernetes for automated, secure releases.
- Manage automated deployments using Helm charts, ArgoCD, ensuring reproducibility and stability.
- Operate and secure platforms, integrating IAM, monitoring, and logging into customer environments.
- Translate business requirements into data products using open-source analytics services on Kubernetes, supporting data sovereignty.
- Continuously update cloud, data, and software engineering knowledge, sharing insights with the team and clients.
Requirements
- University degree or equivalent qualification; practical experience with Spark, Kafka, Airflow, especially in production.
- Hands‑on Kubernetes skills (deployments, services, secrets, Helm charts) and enthusiasm for containerized platforms.
- Solid programming skills in Java, Scala, or Python; experience with build and CI/CD tools (Maven, sbt, Gradle, Git).
- Understanding of cloud service models (IaaS, PaaS, SaaS) and basic Infrastructure‑as‑Code (Terraform, Ansible, Puppet).
- Passion for complex data landscapes, modern analytics technologies, and end‑to‑end solution design.
- Proficiency with AI tools in the data engineering domain, critical evaluation of results, and supporting AI adoption.
- Very good German and good English communication skills.