Big Data Engineer

Role Overview

Employees in this job function are responsible for designing, developing, testing and maintaining software applications and products to meet customer needs. They are involved in the entire software development lifecycle including designing software architecture, writing code, testing for quality and deploying the software to meet customer requirements.

Responsibilities

• Engage with customers to deeply understand their use-cases, pain points, and requirements.
• Solve complex problems by designing, developing, and delivering using various tools, languages, frameworks, and methodologies like agile.
• Assess requirements and determine the most suitable technology stack, integration method, and deployment strategy.
• Create high-level software architecture designs.
• Collaborate with cross-functional teams like product owners, designers, and architects.
• Define and implement software test strategy, guidelines, policies, and processes.
• Continuously improve performance and optimize applications.
• Implement test-driven development, continuous integration, and continuous delivery.
• Support security practices including encryption and anonymization.
• Create user-friendly interfaces and develop back-end applications like APIs and microservices.

Requirements

• 3+ years of Alteryx experience.
• 2+ years of dbt Core, Dataform, or GCP experience.
• Proven experience with Python.

Skills

• dbt
• Dataform
• Python
• Alteryx
• GCP

Nice to Have

• Google Cloud Platform (BigQuery, Dataflow, Dataproc, Data Fusion)
• Terraform
• Tekton
• Cloud SQL
• Airflow
• Postgres
• PySpark
• API