Role Overview
We are seeking an experienced AWS Data Engineer with 8+ years of experience in designing, developing, and maintaining scalable data platforms on AWS. The ideal candidate should have expertise in building data pipelines, data lakes, ETL processes, cloud data warehousing, and big data technologies.
Responsibilities
- Design, develop, and maintain scalable data pipelines on AWS.
- Build and optimize ETL/ELT workflows for processing large-scale datasets.
- Develop and manage data lakes and cloud-based data warehouses.
- Implement data integration solutions from multiple sources.
- Work closely with business stakeholders and technical teams to understand data requirements.
- Ensure data quality, governance, security, and compliance standards.
- Optimize data processing performance and troubleshoot pipeline issues.
- Implement monitoring, automation, and CI/CD practices for data engineering workflows.
- Collaborate with architects and analytics teams to deliver data-driven solutions.
- Mentor junior engineers and contribute to best practices.
Requirements
- 8+ years of experience in Data Engineering.
- Strong hands-on experience with AWS Glue.
- Expertise in Amazon Redshift and data warehousing concepts.
- Experience with Amazon S3, AWS Lambda, and Amazon EMR.
- Strong proficiency in SQL and query optimization.
- Hands-on experience with Python and PySpark.
- Experience building and maintaining ETL/ELT pipelines.
- Knowledge of data modeling and dimensional modeling.
- Experience with Git, CI/CD, and DevOps practices.
- Understanding of cloud security and data governance principles.
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.