Azure Data Engineer

Role Overview

We are looking for an Azure Data Engineer with 4 to 8 years of experience and strong expertise in Azure Databricks, ETL, and PySpark. The candidate will be responsible for designing and building scalable, high-performance data solutions on Azure to support analytics and business use cases. The ideal candidate will collaborate with cross-functional teams to develop reliable data pipelines and ensure high standards of performance, data quality, security, and scalability across the Azure ecosystem.

Responsibilities

• Design, develop, and optimize scalable data pipelines using Azure Databricks and PySpark
• Build and maintain robust ETL/ELT workflows for batch and large-scale data processing
• Develop reusable Databricks notebooks and PySpark components for data ingestion, transformation, and validation
• Integrate data from multiple structured and unstructured sources into the Azure data platform
• Design and implement Delta Lake and medallion architecture for reliable and efficient data processing
• Orchestrate and monitor data pipelines using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and related Azure services
• Implement data quality, governance, security, monitoring, and performance-tuning mechanisms
• Collaborate with business, analytics, and engineering teams to translate requirements into production-ready data solutions
• Troubleshoot and resolve ETL pipeline, Databricks, PySpark, and production issues

Requirements

• 4 to 8 years of experience in Data Engineering
• Strong hands-on experience with Azure Databricks, Apache Spark, PySpark, and Delta Lake
• Strong experience in designing, developing, and optimizing ETL/ELT pipelines
• Good proficiency in SQL, data transformation, and query optimization
• Experience with Azure services such as Data Factory (ADF), Data Lake Storage (ADLS), and Synapse
• Strong understanding of data warehousing, data modeling, medallion architecture, and pipeline design
• Working knowledge of Git, CI/CD practices, and Azure DevOps

Skills

• Azure Databricks
• PySpark
• ETL
• Azure Data Factory
• Delta Lake

Benefits

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents