Role Overview
As a Data Engineer with Reply's Data Reply team in London, you will design and develop high-performance big data applications, manage complex datasets, and support clients throughout the development lifecycle. The consulting role uses SQL, AWS, and Databricks to transform data into business value while offering extensive training and career progression.
Responsibilities
- Translate functional requirements into clear technical requirements.
- Design, develop, and operate stable end-to-end big data applications that process batch and real-time data at scale in multi-tenant cloud environments.
- Build tools for data acquisition, extraction, transformation, management, and manipulation of large, complex datasets.
- Own the full development lifecycle, including design, development, build, deployment, monitoring, and operations.
- Research emerging technologies and industry trends to identify opportunities for early adoption and business value.
Requirements
- A minimum bachelor's degree in Computer Science or a directly related IT discipline.
- At least 1–2 years of experience handling big data projects with SQL and Python, including ETL/ELT and data warehousing concepts.
- Demonstrable experience using AWS and/or Databricks.
- A strong foundation in key Python data engineering concepts, including Pandas, numpy, file handling, and JSON.
- A solid understanding of AWS cloud environments, including S3, Lambda, RDS, AWS CDK or Terraform, and DynamoDB.
- Research into leveraging Agentic AI to streamline the data engineering lifecycle.
- Excellent communication skills and the ability to explain complex information meaningfully to varied audiences.
- A passion for technology and a strong interest in pursuing a specialist career as a Data Engineer.
- Flexibility regarding local business travel.