Azure Data Engineer

Role Overview

We are looking for an experienced Azure Data Engineer with 8+ years of experience in designing, developing, and implementing enterprise-scale data solutions on Microsoft Azure. The ideal candidate should possess strong expertise in Azure Data Services, Databricks, Data Warehousing, ETL/ELT processes, and cloud-based analytics platforms.

Responsibilities

• Design, develop, and maintain scalable and high-performance data pipelines on Azure.
• Build and optimize ETL/ELT workflows using Azure Data Factory (ADF) and Azure Databricks.
• Develop and manage data lakes, data warehouses, and analytical solutions.
• Implement data integration solutions across multiple enterprise systems.
• Work closely with business stakeholders, architects, and developers to gather and translate data requirements.
• Optimize SQL queries, data models, and processing performance.
• Ensure data quality, security, governance, and compliance standards are met.
• Implement monitoring, troubleshooting, and performance tuning of data pipelines.
• Support CI/CD implementation and DevOps best practices for data engineering projects.
• Mentor junior team members and contribute to technical solution design.

Requirements

• 8+ years of overall experience in Data Engineering.
• Strong hands-on experience with Azure Data Factory (ADF).
• Expertise in Azure Databricks and PySpark.
• Experience with Azure Synapse Analytics.
• Strong proficiency in SQL and performance optimization.
• Experience with Azure Data Lake Storage (ADLS).
• Knowledge of Python and data processing frameworks.
• Strong understanding of data modeling, data warehousing, and dimensional modeling concepts.
• Experience with Git, Azure DevOps, and CI/CD pipelines.
• Experience working with large-scale data processing and cloud-based architectures.
• Preferred: Experience with Snowflake.
• Preferred: Knowledge of Power BI and reporting solutions.
• Preferred: Azure Certifications (Azure Data Engineer Associate).
• Education: Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.