Role Overview
As a Data Engineer at Australian Payments Plus, you will turn data flowing through Australia's payments ecosystem into trusted, usable assets. This hands-on role designs, builds and productionises secure, scalable data pipelines across a modern data platform, working with Snowflake, AWS, Python, SQL, APIs and real-time data to make payment and transaction data reliable and accessible.
Responsibilities
- Design, build, deploy and maintain scalable batch and real-time data pipelines for large, complex datasets.
- Build ingestion pipelines from APIs, databases, files, event streams and third-party platforms.
- Implement orchestration, observability, error handling, reconciliation and recovery mechanisms.
- Apply incremental processing, CDC and event-driven integration patterns.
- Develop Snowflake tables, views, schemas, stored procedures and data quality tests.
- Monitor and optimise pipeline performance, troubleshoot issues and provide on-call support.
Requirements
- 2+ years hands-on experience building enterprise or bank-grade data infrastructure, ideally in payments, banking or financial services.
- Experience with cloud databases like Snowflake, DBT, orchestration tools like Airflow, and event streaming platforms like Kafka.
- Strong Snowflake, SQL and NoSQL experience, including complex queries, transformations and large-scale data manipulation.
- Strong Python capability for building data pipelines, API integrations, ETL and cloud infrastructure such as AWS.
- Solid understanding of data modelling, data quality, reconciliation, governance and security for transaction or payment data.
- Experience connecting data across warehouses, lakes, streaming platforms and analytics tools.
- Comfortable working autonomously in Agile teams and partnering with analysts and business stakeholders.