Role Overview
We are seeking an experienced Azure Data Engineer to monitor, support, and optimize our data pipelines and cloud infrastructure. This role focuses on ensuring the smooth operation of data ingestion, transformation, and scheduling processes within an Azure environment.
Responsibilities
- Oversee Azure Data Factory pipelines, triggers, and linked services to ensure smooth operations.
- Identify, analyze, and resolve issues related to data ingestion, transformation, and scheduling.
- Apply strong querying and analytical skills to validate and optimize data processes.
- Perform regular health checks on data load processes and Azure SQL or Snowflake databases and implement performance tuning.
- Collaborate with development teams to ensure smooth deployment and operation of data workflows.
- Maintain documentation for support procedures, incident resolution, and knowledge base.
- Implement alerts and automation for proactive issue detection.
- Ensure data integrity and security across all supported systems.
- Participate in root cause analysis and continuous improvement initiatives.
- Provide guidance to junior developers and improve code/process quality through reviews.
Requirements
- 4-5 years of experience supporting Azure Data Factory and Azure SQL.
- Strong understanding of ETL processes, data integration, and SQL querying.
- Experience with Azure Monitor, Log Analytics, and Alerts.
- Experience with PowerShell, Azure CLI, or Python for automation.
- Knowledge of Azure Synapse, Data Lake, or Databricks is a plus.
- Knowledge of ITSM tools such as Cherwell or ServiceNow and monitoring tools like Control-M.
- Understanding of Agile and Kanban processes.
- Strong problem-solving, communication, and teamwork capabilities.
Skills
- Azure Data Factory
- Azure SQL
- Snowflake
- Python
- SQL
Nice to Have
- Experience with Azure DevOps, Blob Storage, Azure Functions, Logic App, Key Vault, Application Insights, and Azure Monitor.
- Familiarity with ITSM tools.