Role Overview
Data Engineer - AWS responsible for building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near-real-time processing, with strong communication and troubleshooting skills.
Responsibilities
- Build, enhance, and maintain data pipeline frameworks for batch, streaming, and near-real-time processing.
- Design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.
- Implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.
- Develop ETL/ELT processes and SQL-based transformations using distributed data processing.
- Implement APIs and work with Kafka, PostgreSQL, and AWS.
Requirements
- Good communication skills with knowledge of Kafka, API implementation, PostgreSQL, and AWS.
- Strong understanding of the SDLC process.
- Strong troubleshooting skills.
- Strong experience building, enhancing, and maintaining data pipeline frameworks.
- Proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.
- AWS certification is nice to have.