Role Overview
Data engineering role focused on building, enhancing, and maintaining data pipeline frameworks for batch, streaming, and near-real-time processing, with Kafka, API implementation, PostgreSQL, and AWS.
Responsibilities
- Build, enhance, and maintain data pipeline frameworks supporting batch, streaming, and near-real-time processing.
- Design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
- Implement production-grade pipelines with error handling, logging, monitoring, and performance optimization.
Requirements
- Strong understanding of SDLC process.
- Strong troubleshooting skills.
- Proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
- Experience with Kafka, API implementation, PostgreSQL, and AWS.
- Good communication skills.