Download App
Azure Data Engineer
Persistent Systems
Actively HiringFull-time
Location
TN, IN
Experience
4-8 years
Role
Azure Data Engineer
Salary
Competitive
Your Application Toolkit
Stand out. Get hired.
80% of applicants fail the initial ATS screen. Check your compatibility before you apply and stand out from the crowd.
Share this job
Know someone who'd be a great fit?
Job Description
Role Overview
We are looking for an Azure Data Engineer with 4 to 8 years of experience and strong expertise in Azure Databricks, Python, and Generative AI. The candidate will design and build scalable data platforms and AI-enabled data solutions on Azure for analytics and business use cases.
Responsibilities
- Design, develop, and optimize scalable data pipelines using Azure Databricks and Python
- Build and maintain robust ETL/ELT workflows for batch and streaming data processing
- Develop reusable Python frameworks and Databricks notebooks for data ingestion, transformation, and validation
- Process and transform large-scale datasets using Apache Spark and PySpark
- Design and implement Delta Lake and medallion architecture for reliable data processing
- Integrate data solutions with Azure services such as Data Factory (ADF), Data Lake Storage (ADLS), and Synapse
- Implement data quality, governance, security, monitoring, and performance-tuning mechanisms
- Collaborate with business, analytics, and engineering teams to translate requirements into production-ready solutions
- Troubleshoot and resolve data pipeline, Databricks, Python, and production issues
Requirements
- 4 to 8 years of experience in Data Engineering
- Strong hands-on experience with Azure Databricks, Apache Spark, PySpark, and Delta Lake
- Advanced proficiency in Python, including data processing, APIs, reusable modules, and automation
- Strong proficiency in SQL and experience with query optimization
- Experience with Azure services such as Data Factory (ADF), Data Lake Storage (ADLS), and Synapse
- Strong understanding of data warehousing, ETL/ELT, data modeling, medallion architecture, and pipeline design
- Working knowledge of Git, CI/CD practices, and Azure DevOps
Skills
- Azure Databricks
- Python
- Apache Spark
- PySpark
- SQL
Benefits
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization
Required Skills
Azure DatabricksPythonApache SparkPySparkSQL
Ready to make your move?
Take the next step in your career. Apply directly on the company's platform.
Apply for this role