Role Overview
Data Engineer - AWS role focused on building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near-real-time processing. Requires strong communication skills and knowledge of Kafka, API implementation, PostgreSQL, and AWS.
Responsibilities
- Build, enhance, and maintain data pipeline frameworks supporting batch, streaming, and near-real-time processing.
- Design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
- Implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.
Requirements
- Strong understanding of SDLC process.
- Strong understanding and troubleshooting skills.
- Proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
- Good communication skills with knowledge on Kafka, API implementation, PostgreSQL, and AWS.