XPT Software Australia logo for Data Engineer with GCP job on DevsUnite

Data Engineer with GCP

XPT Software Australia

Actively HiringFull-time
Apply
Location

Sydney, New South Wales, Australia

Experience

2-4 years

Role

Data Engineer with GCP

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

We are seeking a Data Engineer with GCP to design, develop, and maintain scalable data pipelines on Google Cloud. You will build and optimise ETL/ELT workflows for batch and real-time data processing, work with BigQuery for data warehousing and SQL development, and ensure data quality, security, and governance across the platform.

Responsibilities

  • Design, develop, and maintain scalable data pipelines using GCP services.
  • Build and optimise ETL/ELT workflows for batch and real-time data processing.
  • Work with Google BigQuery for data warehousing, SQL development, and query optimisation.
  • Develop data processing solutions using Python, PySpark, and Apache Beam.
  • Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub.
  • Build and manage data lakes and data warehouses on Google Cloud.
  • Implement data quality checks, data validation, and monitoring.
  • Optimise pipeline performance, scalability, and cost efficiency.
  • Collaborate with data analysts, data scientists, architects, and business teams.
  • Ensure data security, governance, and compliance best practices.

Requirements

  • Strong experience in Google Cloud Platform (GCP).
  • Hands-on experience with BigQuery.
  • Strong programming skills in Python and SQL.
  • Experience developing ETL/ELT data pipelines.
  • Experience with Cloud Dataflow and/or Apache Beam.
  • Knowledge of Cloud Storage (GCS).
  • Experience with data modelling and data warehousing.
  • Experience with batch and real-time data processing.

Required Skills

Google Cloud Platform (GCP)BigQueryPythonSQLApache Beam

Ready to apply for Data Engineer with GCP?

See how you stack up at XPT Software Australia before you apply, or go straight to the application.

Apply Anyway