Data Engineer (Software Engineer II)

Role Overview

As a Software Engineer II at JPMorganChase within the Workforce Technology, Employee Platforms team, you are part of an agile team that works to enhance, design, and deliver the software components of the firm's state-of-the-art technology products in a secure, stable, and scalable way. You will execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system.

Responsibilities

• Executes standard software solution, design, development, and technical troubleshooting.
• Manage data integration and data analysis of disparate systems.
• Build extensible data acquisition and integration solutions to meet functional and non-functional requirements.
• Implement processes and logic to extract, transform, and distribute data across one or more data stores.
• Interface with internal product development teams and cross-functional teams including Product Management and Quality Engineering.
• Leverage enterprise-authorized AI coding assist tools to improve code quality and productivity.
• Gather and analyze large, diverse data sets to identify problems and contribute to decision-making.

Requirements

• 4+ years experience in data integration projects using Big Data Technologies.
• Experience in AWS Data Warehousing and database platforms with hands-on delivery using EMR, S3, AWS Glue, Lambda, Apache Airflow and Infrastructure as Code (Terraform/CloudFormation).
• Strong experience in CICD using Jenkins, Git, Artifactory, Yaml, and Maven for Cloud deployments.
• Hands on experience on Spark engineering with PySpark/Scala for building and optimizing scalable data pipelines.
• Knowledge of Big Data querying tools such as Athena, RDS, and Databricks SQL Warehouse.
• Experience integrating data from file-storage formats like Parquet, ORC, Avro and table formats like Delta Lake or Iceberg.
• Strong knowledge of Data Warehousing, Data Modeling and Data Lake concepts.
• Strong experience with Java open-source and API standards.
• Hands-on experience using enterprise-authorized AI-assisted software development tools.

Skills

• AWS
• PySpark
• Java
• Apache Airflow
• Terraform