GCP Data Engineer

Role Overview

We are looking for experienced candidates for the role of GCP Data Engineer to design and implement robust data solutions.

Responsibilities

• Design batch and real-time data pipelines.
• Develop scalable ETL/ELT pipelines using Dataflow, BigQuery and Composer.
• Ingest data from databases, APIs, files, SaaS applications and streaming sources.
• Design optimized BigQuery datasets, tables, partitioning and clustering.
• Build data transformations using SQL, Python, Beam, Spark or dbt/Dataform.
• Implement orchestration and dependency management using Airflow/Cloud Composer.
• Handle data quality, reconciliation, lineage and monitoring.
• Implement GCP security using IAM, service accounts and least-privilege access.
• Optimize BigQuery/Dataflow workloads for performance and cloud cost.
• Build infrastructure using Terraform and participate in CI/CD.
• Troubleshoot production data-pipeline failures.
• Work with Data Architects, Analysts, Data Scientists and application teams.

Requirements

• 6+ years of experience in data engineering roles.

Skills

• GCP
• Python
• SQL
• BigQuery
• Terraform