IMC Trading logo for Site Reliability Engineer - Data Engineering job on DevsUnite

Site Reliability Engineer - Data Engineering

IMC Trading

Actively HiringFull-time
Apply
Location

Sydney, New South Wales, Australia

Experience

2+ years

Role

Site Reliability Engineer - Data Engineering

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.

Responsibilities

  • Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.
  • Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.
  • Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.
  • Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.

Requirements

  • 2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role.
  • Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.
  • Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.
  • Working knowledge of Docker, Kubernetes, and Helm.
  • Experience with data access technologies such as Dremio and Presto.
  • Familiarity with workflow orchestration tools like Airflow and Prefect.
  • Exposure to cloud platforms such as AWS, GCP, or Azure.

Required Skills

KubernetesKafkaLinuxAWSAirflow

Ready to apply for Site Reliability Engineer - Data Engineering?

See how you stack up at IMC Trading before you apply, or go straight to the application.

Apply Anyway