Role Overview
We are looking for a skilled Data Engineer with 4-7 years of experience to design and develop scalable ETL/ELT pipelines, process large datasets, and build reliable data solutions for analytics and reporting. This is a contract role for 3-6 months with potential for extension.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Develop data processing solutions using Python and PySpark.
- Write and optimize complex SQL queries, stored procedures, and database objects.
- Build and maintain cloud-based data pipelines using AWS or Azure data services.
- Ingest, transform, and integrate structured and semi-structured data from multiple data sources.
- Perform data transformation, cleansing, validation, and integration.
- Build and maintain efficient data models for analytics and reporting.
- Monitor data pipelines and troubleshoot performance, reliability, and data quality issues.
- Optimize data processing jobs for scalability and performance.
- Collaborate with cross-functional teams including Data Analysts and BI developers.
- Ensure data quality, reliability, security, and governance across data platforms.
- Follow best practices for code quality, testing, documentation, version control, and CI/CD.
Requirements
- 4 - 7 years of professional experience in Data Engineering.
- Strong programming skills in Python.
- Strong hands-on experience with SQL, including joins, CTEs, window functions, and query optimization.
- Hands-on experience with PySpark / Apache Spark for large-scale data processing.
- Strong understanding of ETL/ELT concepts and data integration.
- Experience working with cloud platforms such as AWS or Azure.
- Ability to work in person.
Compensation & Terms
- Pay: ₹120,000.00 per month (Fixed take home).
- Contract duration: 3-6 months (may be extended).
- Note: No PF or ESI provided as this is a contract position via a third-party payroll.