Role Overview
We're looking for a Data Engineer III to join our Data Engineering team, building and governing the data foundation that powers the business. You'll work within our stack — Python ingestion pipelines, Airflow orchestration, and Snowflake/Databricks — helping move data reliably and securely from source to decision-ready output.
Responsibilities
- Implement new ingestion sources end-to-end against a senior engineer's design, including connector code, DAG, schema, monitoring, and catalog registration.
- Investigate pipeline failures independently, recognize known classes of issues, and ship documented fixes.
- Before shipping a new pipeline, identify downstream consumers and potential breakages from late or wrong data.
- Write clear handovers when escalating unresolved issues with context tried and ruled out.
- Review peers' pipeline PRs and catch non-obvious issues like missing idempotency checks or race conditions.
- Turn ambiguous data issues into structured investigations tracing lineage from source to warehouse.
- Surface spec review concerns as specific, well-reasoned questions.
- Support data security and governance work, including PII masking and access controls.
- Build relationships with internal stakeholders and help scope requirements.
- Mentor DE2s on their first significant projects.
Requirements
- 3–5 years of professional software or data engineering experience.
- Strong SQL and Python skills with production pipeline experience.
- Comfort investigating and root-causing pipeline issues independently.
- Experience with workflow orchestration tools like Airflow and a cloud data warehouse/lakehouse like Snowflake or Databricks.
- Solid understanding of data pipeline concepts: idempotency, schema evolution, backfills, and data quality/testing.
- Experience giving substantive code review feedback.
- Strong communication skills for technical handovers and lineage investigations.
- Track record of taking ownership of known-class problems end-to-end.