Role Overview
We are seeking a skilled Azure Data Engineer to design, implement, and maintain scalable data pipelines and storage solutions within the Microsoft Azure ecosystem. You will be responsible for building robust ETL/ELT processes and collaborating with stakeholders to deliver high-quality, data-driven solutions.
Responsibilities
- Design and implement scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure services.
- Develop, optimize, and maintain data storage solutions utilizing Azure SQL Database, Azure Data Lake Storage, and Azure Cosmos DB.
- Build and manage ETL/ELT processes, ensuring robust data integration and reliability.
- Collaborate with business and technical stakeholders to gather requirements and deliver data-driven solutions.
- Monitor, troubleshoot, and optimize data pipelines for both performance and cost.
- Implement and ensure data security, privacy, and compliance in accordance with industry standards.
- Maintain up-to-date documentation for data workflows, storage architectures, and processes.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or related discipline.
- 3 years of experience in data engineering, including hands-on work with Microsoft Azure Data Services.
- Strong proficiency in SQL, data modeling, and ETL process design.
- Experience with Python and/or other relevant programming languages.
- Demonstrated expertise in Azure Data Factory, Data Lake, Databricks, Synapse Analytics, and Cosmos DB.
- Experience in Power BI or other BI/data visualization tools.
- Familiarity with DevOps practices and CI/CD pipelines.
- Knowledge of data security best practices in cloud environments.
Nice to Have
- Microsoft Certified Azure Data Engineer Associate or Databricks Engineer certifications.
Benefits
- Flexible schedule
- Leave encashment
- Life insurance
- Provident Fund
- Work from home
Skills
- Azure Data Factory
- Azure Databricks
- Python
- SQL
- Azure Cosmos DB