Data Engineer - Software Engineer

Role Overview

We are looking for experienced Data Engineers with strong hands on experience in designing, developing and enhancing modern data engineering solutions. The role will involve working with cloud data platforms, data pipelines, data integration, data transformation and analytics solutions. The ideal candidate will have strong experience in Snowflake, Databricks and AWS data services, along with good SQL and data engineering fundamentals. The role will primarily focus on development and enhancement activities, with some involvement in deployment, monitoring and production support as part of the overall application lifecycle.

Responsibilities

• Design, develop and maintain scalable data pipelines and data engineering solutions.
• Develop data ingestion, transformation and processing workflows using cloud based technologies.
• Work with Snowflake and Databricks to build and optimize data processing and analytical solutions.
• Develop and maintain data pipelines using AWS Glue, S3 and Lambda.
• Implement data transformation, cleansing, validation and integration processes.
• Develop efficient SQL queries and optimize data processing and warehouse workloads.
• Work with business and technical teams to understand data requirements and translate them into technical solutions.
• Participate in solution design, development, testing and deployment activities.
• Develop reusable components and follow established data engineering and coding standards.
• Troubleshoot data pipeline and application issues and implement appropriate fixes.
• Participate in code reviews, technical discussions and continuous improvement initiatives.
• Support deployment and release activities across environments.
• Monitor data pipelines and proactively identify issues affecting data processing or availability.
• Provide support for production issues when required, including troubleshooting and root cause analysis.
• Maintain technical documentation and operational procedures.

Requirements

• 3–5 years of experience in data engineering and ETL/ELT development.
• Strong hands on experience with Snowflake and/or Databricks.
• Strong SQL and data transformation skills.
• Exposure to cloud based data platforms and data pipelines.
• Experience with AWS Glue, Amazon S3, and AWS Lambda.
• Knowledge of Delta Lake, PySpark, and/or Spark.
• Bachelor's degree in Computer Science, Information Technology, Engineering or a related discipline.

Skills

• Snowflake
• Databricks
• AWS
• SQL
• PySpark