Role Overview
As a Microsoft Fabric Data Engineer, you will design and maintain Fabric Lakehouse environments, implementing Medallion Architecture to support high-performance analytics, data quality, and governance. You will be responsible for creating curated datasets for reporting, analytics, and AI/ML use cases while ensuring data consistency across platforms.
Responsibilities
- Design, develop, and maintain scalable data ingestion and transformation pipelines using Microsoft Fabric.
- Build and manage ETL/ELT workflows using Fabric Data Factory and Data Pipelines.
- Develop data transformation logic using PySpark, Spark SQL, and notebooks.
- Implement Delta Tables and Medallion Architecture (Bronze, Silver, Gold layers).
- Integrate data from multiple sources including databases, APIs, and cloud storage.
- Design dimensional and analytical data models to support Power BI semantic models.
- Implement incremental data loads and Change Data Capture (CDC) strategies.
Requirements
- Graduate in Computer Science, Data Science, or a related field.
- 4-6 years of experience in data engineering or a related field.
- Proficiency in SQL, PySpark, and Spark SQL.
- Experience with Delta Lake and OneLake.
- Strong understanding of ETL/ELT, Data Modeling, and Data Warehousing.
- Experience with Git Version Control and Azure DevOps.
Skills
- Microsoft Fabric
- PySpark
- Azure Data Services
- SQL
- Delta Lake
Nice to Have
- Experience in large-scale enterprise data transformation programs.
- Knowledge of Data Mesh and Modern Data Platform concepts.
- Exposure to AI/ML data preparation processes.
- Microsoft Fabric Certification.
- Experience in Banking, Insurance, Healthcare, or Retail domains.