Role Overview

We are looking for a skilled Data Engineer with strong expertise in Microsoft Fabric, SQL, Python, and PySpark to build and optimize modern data lakehouse solutions and scalable enterprise data pipelines.

Responsibilities

Develop, test, and maintain data ingestion and transformation pipelines using Microsoft Fabric
Build and optimize Bronze, Silver, and Gold layer data assets using Medallion Architecture
Work on Fabric Pipelines, Dataflows Gen2, Notebooks, Lakehouse, Warehouse, and OneLake
Integrate and transform enterprise, API-based, clinical, and cloud data sources
Build dimensional models, star schemas, facts, and dimensions for Power BI reporting
Implement data validation, reconciliation, logging, and error-handling frameworks
Troubleshoot and optimize pipeline performance and data processing workflows

Requirements

Strong hands-on experience with Microsoft Fabric, including:

Lakehouse
Pipelines
Dataflows Gen2
Warehouse
Notebooks
OneLake

Additional Requirements:

Strong SQL and Python expertise
Experience with PySpark or Spark-based processing
Strong understanding of ETL/ELT, Data Warehousing, and Dimensional Modeling
Knowledge of Data Quality, Data Cleansing, and Transformation logic
Familiarity with Git, Azure DevOps, CI/CD pipelines, and Agile workflows

Preferred Skills:

Experience with Power BI integration and reporting datasets
Exposure to Azure ecosystem tools such as ADF, Synapse, or Databricks
Experience in Healthcare, Pharma, CRO, or Clinical Research domains
Strong analytical and problem-solving skills