Job Description: Responsibilities
- Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks
- Create build from Github and release pipeline and Databricks using Azure Devops / Harness
- Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
- Diagnose system performance issue related to data processing and implement solution to address
- Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
- Maintain integrity and quality across all pipelines and environments.
- Understand and follow secure coding practice to make sure code is not vulnerable
Responsibilities: Responsibilities
- Design, Develop and maintain Business Translation Layer (BTL) pipelines using SQL/DBT in Azure Databricks
- Create build from Github and release pipeline and Databricks using Azure Devops / Harness
- Monitor Performance of BTL Jobs, resolve any issues and improve the performance metrics as needed.
- Diagnose system performance issue related to data processing and implement solution to address
- Collaborate with other teams to ensure successful integration of data pipelines into larger system architecture requirement.
- Maintain integrity and quality across all pipelines and environments.
- Understand and follow secure coding practice to make sure code is not vulnerable
Qualifications: Skills
- Should have Strong background in…