CGI logo for Software Engineer- Scala Developer job on DevsUnite

Software Engineer- Scala Developer

CGI

Actively HiringFull-time
Apply
Location

Bengaluru, Karnataka, India

Experience

3-4 years

Role

Software Engineer- Scala Developer

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

We are seeking a Senior Data Engineer to design, build, and optimize next-generation data architecture on Google Cloud Platform, including the BigQuery warehouse, while supporting data engineering responsibilities.

Responsibilities

  • Design and implement complex ETL/ELT pipelines from disparate sources into a centralized data lake or warehouse.
  • Manage large-scale Apache Spark clusters and perform petabyte-scale transformations using Python or Scala.
  • Write and optimize complex SQL queries for data modeling and BigQuery performance.
  • Develop real-time processing using Pub/Sub and Dataflow.
  • Manage workflow automation using Cloud Composer and architect storage and databases across GCP.

Requirements

  • Mastery of Python or Scala.
  • Proven experience tuning and debugging Spark jobs at scale.
  • Deep hands-on experience with the full Google Cloud data suite, including BigQuery, Dataflow, Dataproc, and Pub/Sub.
  • Ability to perform complex window functions, CTEs, and query optimization.

Required Skills

ScalaApache SparkPythonGoogle BigQueryGoogle Cloud Platform

Ready to apply for Software Engineer- Scala Developer?

See how you stack up at CGI before you apply, or go straight to the application.

Apply Anyway