Role Overview
We are hiring a Data Engineer with 4+ years of experience to join our team in Bangalore. This role involves developing and supporting real-time and batch data processing pipelines while ensuring high data quality and platform reliability.
Responsibilities
- Develop and support real-time and batch data processing pipelines using SQL, Python, PySpark, and Hive.
- Build and execute SQL-based financial reports and support monthly financial reconciliation processes.
- Troubleshoot data issues, perform deep root cause analysis (RCA), and resolve anomalies using MySQL, HBase, and HDFS.
- Implement and maintain data quality, data lineage, SLA monitoring, and platform reliability solutions.
- Develop observability dashboards, automation, and diagnostic solutions to improve data pipeline performance and reliability.
- Collaborate with Finance Controllers and business stakeholders to ensure accurate financial reporting and reconciliation.
- Perform SQL, Python, and PySpark performance tuning and contribute to initiatives involving DataHub, Java, and microservices architecture.
Requirements
- 4+ years of experience in Data Engineering.
- Strong expertise in data processing and troubleshooting.
- Ability to work in person in Bangalore.
Skills
- Python
- PySpark
- SQL
- Hive
- Hadoop
Benefits
- Salary: ₹500,000.00 - ₹1,200,000.00 per year.