Data Operations Engineer

Role Overview

At Circana, customer experience is at the forefront of everything we do. To help us build functional systems that improve the customer experience, we’re looking for a Data Operations Engineer who can be responsible for deploying product updates, identifying production issues, and implementing integrations that meet our customers’ needs. The ideal candidate will have a solid background in software engineering and will work with developers and engineers to ensure that software development follows established processes and works as intended.

Responsibilities

• Continuously monitor data loading processes in production, identifying potential bottlenecks, errors, or anomalies in real-time using monitoring tools.
• Diagnose and resolve data loading errors, including data format issues, connectivity problems, mapping errors, and data integrity concerns.
• Investigate the root cause of recurring data loading problems and implement preventive measures.
• Perform quality checks on loaded data to ensure accuracy and consistency with expected data patterns.
• Respond to data loading incidents promptly and escalate critical issues to relevant stakeholders.
• Maintain clear documentation of data loading procedures, troubleshooting guides, and best practices.

Requirements

• 1 – 4 years of work experience in large data integration and Data warehousing environment.
• Experience as an Operations engineer or in a similar software engineering role.
• Ability to evaluate existing operational workflows and identify areas for enhancement.
• Collaborate with cross-functional teams to execute changes and monitor effectiveness.
• Exposure to using automated scripts for data extraction, loading and validations.
• Exposure to handling data from various sources such as Flat files, Excel, Access, Oracle/Hadoop, Azure, GCP, AWS etc.
• Working knowledge of databases and SQL.
• Job scheduling experience through Control-M or Airflow.
• Problem-solving attitude and collaborative team spirit.

Nice to Have

• Bachelor of science degree in computer science, engineering, or a relevant field.
• Experience in building or maintaining ETL processes.
• Experience in data load monitoring and investigation.
• Ability to work in a 24x7 environment.

Skills

• Python
• SQL
• Unix
• Airflow
• Shell Scripting