Role Overview
The Product team at Epsilon develops and builds products that position the company as a differentiator, using industry standard methodologies and sophisticated capabilities in data, machine learning, and artificial intelligence. We are looking for data artisans keen on embracing the latest in technology and trends to improve our product offerings through high-quality data assets.
Responsibilities
- Own the end-to-end lifecycle of automated quality checks from design through deployment, monitoring, and iteration.
- Translate business requirements into technical data quality rules.
- Full stack development for Data lake / Delta lake's Data Quality & Data Observability.
- Perform data profiling and auditing to identify anomalies, trends, and data quality risks.
- Implement Intuitive Data Quality Scoring and Timely Warnings/Issue Reporting.
- Facilitate Collaborative Remediation across teams.
- Work within Agile Methodologies (SCRUM).
Requirements
- Bachelor's Degree in Computer Science or equivalent degree.
- 3-5 years in data engineering, data quality engineering, analytics engineering, or a related field.
- Strong programming skills in Python and Angular JS.
- Hands on experience in PySpark.
- Experience implementing automated data quality checks, testing, or monitoring frameworks.
- Familiarity with data quality dimensions and cloud data platforms, APIs, and governance/quality tooling.
- Ability to participate in code reviews and troubleshoot problems quickly.
Nice to Have
- Hands-on with Databricks for unified data analytics, including Databricks Notebooks, Delta Lake, and Catalogues.
- Experience with Metadata, lineage, and governance platforms.
- Exposure to AI/ML-assisted classification and human-in-the-loop systems.
Skills
- Python
- Angular JS
- PySpark
- Databricks
- Delta Lake