Role Overview

We are seeking a skilled Azure Databricks Admin/Cloud Engineer to join our dynamic GMDIT team in Bangalore, India. In this role, you will be accountable for the design, implementation, and maintenance of our organization's cloud-based data infrastructure. You will work to ensure that the organization's data is securely stored, easily accessible, and available to those who need it. In addition, you will be working with various Azure-based data storage and processing technologies such as Databricks, Data Factory, ADLS Gen 2, Integration Runtime, Key Vault, MS-Fabric etc. You will need to have a strong understanding of Database & Cloud Infrastructure design, security, and performance tuning to ensure that the systems being created are scalable, reliable, secure and efficient.

Responsibilities

Work closely with Solution Architects, Data Engineers, Data Analysts, and Data Scientists to support their data processing needs and use cases.
Set up, configure, and manage Azure Databricks workspaces and clusters to support data processing and analytics needs, as well as monitor, optimize, and balance the performance and cost efficiency of Databricks clusters, by scaling resources and managing cluster configurations.
Administer data integration and governance capabilities across Azure Databricks, inclusive of Unity catalog, Microsoft Fabric, and Power BI to ensure trusted, compliant data access.
Implement and manage infrastructure as code using Bicep templates to deploy and maintain Azure resources consistently and securely.
Ensure timely execution of data pipelines by creating and managing job schedules in Databricks to automate data processing and ETL workflows.
Implement security measures (e.g., access control, encryption, auditing) to comply with required data protection policies and regulations.
Apply AI Ops and platform automation techniques to proactively identify performance issues, reduce operational incidents, and improve system reliability.
Partner with applicable teams to monitor the health and performance of data pipelines and clusters, troubleshoot issues and resolve errors to maintain system reliability.
Manage user access and permissions ensuring appropriate access levels are assigned to users and roles.
Execute routine platform maintenance including upgrades, performance tuning, backup, and disaster recovery planning, in addition to implementing data backup and disaster recovery strategies to ensure data availability and continuity in the event of an outage or failure.

Requirements

Minimum bachelor’s degree in computer science or related area (or equivalent).
Minimum 5+ years of Admin experience.
Strong Application & Infra Administration understanding of Azure cloud and hands on experience with clear understanding around monitoring, management & governance concepts.
Hands on administrative experience with Azure Databricks including workspace setup, cluster management, job scheduling, and access control.
Proven experience using Bicep for infrastructure as code and supporting CI/CD deployment pipelines.
Effective communication with an ability to collaborate with stakeholders and communicate technical concepts clearly.
Demonstrated problem solving and analytical thinking.
Proficiency with GitHub and standard SDLC practices for platform changes.