Role Overview
We are seeking a highly skilled Cloud Engineer to support and enhance our Data Transformation Platform hosted on Microsoft Azure. The ideal candidate will be responsible for ensuring platform stability, scalability, and performance while driving the implementation of new features and infrastructure improvements.
Responsibilities
- Support and maintain the uptime, performance, and reliability of the Data Transformation Platform.
- Design, build, and optimize cloud infrastructure on Microsoft Azure.
- Develop and maintain scalable Azure DevOps CI/CD pipelines for infrastructure, code, and data deployments.
- Implement Infrastructure as Code (IaC) solutions using Terraform.
- Collaborate closely with Data Engineers, Developers, and Security teams to deliver platform enhancements.
- Design and support data ingestion and transformation pipelines.
- Configure and manage Azure networking components including VNets, NSGs, VPNs, Private Endpoints, and DNS.
- Monitor platform health using Azure Monitor and Log Analytics.
- Implement cloud security best practices including IAM, RBAC, Key Vault, and Azure Policies.
- Create and maintain detailed technical documentation and operational procedures.
- Participate in on-call and out-of-hours support rotations.
- Continuously improve automation, operational efficiency, and platform scalability.
Requirements
- Strong experience with Microsoft Azure Cloud Services.
- Hands-on experience with Azure Databricks.
- Expertise in Terraform for Infrastructure as Code (IaC).
- Experience building and managing Azure DevOps CI/CD pipelines.
- Good understanding of Azure networking: VNets, NSGs, VPN Connectivity, Private Endpoints, and DNS.
- Experience with Data Integration and Data Platform environments.
- Knowledge of monitoring and logging solutions: Azure Monitor and Log Analytics.
- Scripting experience using PowerShell, Bash, or Python.
- Strong understanding of Azure security services: IAM, RBAC, Azure Key Vault, and Azure Policies.
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
Skills
- Microsoft Azure
- Azure Databricks
- Terraform
- Azure DevOps
- Python