Role Overview
The Data Engineer will support the data modeler by handling all ETL code and implementing data lake architecture leveraging Oracle ATP, OCI services, and Oracle analytics tools.
Responsibilities
- Implement data lake architecture leveraging Oracle ATP, OCI services, and Oracle analytics tools.
- Build ingestion pipelines to load massive data from source systems (F&B POS).
- Support batch and near-real-time ingestion using tools such as OCI Data Integration, OIC, OCI Object Storage, REST APIs, and file-based loads.
- Preserve source fidelity, metadata, and audit attributes.
- Implement data quality validations, reconciliation controls, and error handling.
- Transform raw data into cleansed, conformed, and analytics-ready structures.
- Develop business-friendly schemas, dimensions, and fact tables to support reporting and advanced analytics.
- Optimize SQL, indexing, partitioning, external tables, and materialized views within Oracle ATP.
- Collaborate with governance and security teams to ensure compliance.
Requirements
- Experience getting data from MS SQL Server and MySQL is a plus.
- Proven ability to manage ETL processes and data ingestion pipelines.
Skills
- Oracle ATP
- OCI Data Integration
- SQL
- ETL
- OCI Object Storage