Role Overview
We are seeking a Full Stack Data Engineer to join our Central Engineering Portfolio Team in Chennai. You will be responsible for building, ingesting, transforming, and analyzing large datasets to support the Enterprise Data Platform on Google Cloud Platform (GCP), delivering curated data products through end-to-end engineering processes.
Responsibilities
- Deliver curated data products and perform end-to-end Full stack Data engineering roles.
- Develop exceptional analytical data products using both streaming and batch ingestion patterns on GCP.
- Act as a Subject Matter Expert in Data Engineering with a focus on GCP native services.
- Collaborate with data engineers, product owners, and technical experts to advocate for well-designed solutions.
- Work with architects to evaluate and productionalize data pipelines for ingestion, curation, and consumption.
- Formulate business problems into technical data requirements in collaboration with product management.
Requirements
- 5+ years of SQL development and analytics/data product development experience.
- 3+ years of cloud experience (GCP preferred) with production-scale solutions.
- Experience with GCP native services including BigQuery, Google Cloud Storage, PubSub, Dataflow, Dataproc, and Cloud Build.
- Experience with Airflow for scheduling and orchestration.
- Experience with Terraform for Infrastructure as Code.
- 2+ years of professional development experience in Python or Java.
- Bachelor's degree in Computer Science or a related scientific field.
Nice to Have
- In-depth understanding of Gen AI / LLM architectures.
- Experience with DBT, Dataform, or DataPlex.
- Experience with CI/CD tools like Tekton, Git, or Jenkins.
- GCP Professional Data Engineer certification.
- Master's degree in Computer Science.
Skills
- Google Cloud Platform
- SQL
- Python
- Airflow
- Terraform