Data Engineer

Role Overview

We are looking for a skilled Data Engineer to join our growing team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data infrastructure to support business intelligence, analytics, and data-driven decision-making. The candidate should have strong expertise in Python, SQL, ETL processes, cloud technologies, and modern data engineering practices.

Location: Indore
Experience: 3–5 Years

Responsibilities

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and integration.
• Build, optimize, and maintain data warehouses, data lakes, and relational databases.
• Ensure data accuracy, integrity, and consistency through validation and quality assurance processes.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver effective solutions.
• Optimize database performance and manage large-scale datasets for efficient processing.
• Develop and maintain ETL/ELT workflows using industry-standard tools and best practices.
• Work with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Utilize big data technologies including Apache Spark, Hadoop, and Kafka where applicable.
• Automate, schedule, and monitor workflows using Apache Airflow or similar orchestration tools.
• Implement data governance, security, and compliance standards.
• Troubleshoot and resolve data pipeline, database, and ETL-related issues.
• Stay updated with the latest trends and technologies in data engineering.

Requirements

Programming & Database

• Strong proficiency in Python (Pandas, NumPy)
• Excellent SQL skills
• Experience with relational databases such as SQL Server, PostgreSQL, or MySQL

Data Engineering

• Strong understanding of ETL/ELT concepts
• Hands-on experience with Azure Data Factory (ADF), SSIS, or similar ETL tools
• Experience in designing scalable data pipelines

Data Modeling

• Entity-Relationship (ER) Diagrams
• Dimensional Modeling
• Data Normalization

Cloud & Big Data

• Experience with AWS, Azure, or GCP
• Familiarity with Apache Spark, Hadoop, and Kafka
• Knowledge of Apache Airflow for workflow orchestration

Good to Have

• Experience with Git and CI/CD pipelines
• Knowledge of Docker or Kubernetes
• Exposure to Power BI, Tableau, or other BI tools
• Understanding of data governance and security best practices

Qualification

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3–5 years of experience in Data Engineering or a similar role.