Role Overview
Join a major Public Sector client undergoing a significant data platform modernisation initiative. We are seeking an experienced Data Engineer with strong Azure Databricks expertise to support the design, development, and optimisation of enterprise‑scale data solutions on Azure.
Responsibilities
- Develop and maintain data ingestion, transformation, and orchestration pipelines using Azure Databricks.
- Design scalable Lakehouse solutions and modern data architectures on Azure.
- Work with business stakeholders to develop data models and deliver actionable insights.
- Implement best practices across data quality, governance, security, and platform operations.
- Support and enhance Databricks frameworks, automation, and monitoring capabilities.
- Mentor junior engineers and contribute to engineering excellence.
Requirements
- Azure Databricks
- Azure Databricks Genie
- PySpark, Spark SQL, Python
- Azure Data Factory, ADLS, Delta Lake
- Data Warehousing and Dimensional Modelling