Role Overview
As a Software Engineer II - Big Data (ETL) / DevOps Engineer + AWS at JPMorgan Chase within the Commercial & Investment Bank, you'll be a part of an agile team that works to enhance, design, and deliver the software components of the firm's state-of-the-art technology products in a secure, stable, and scalable way. You will execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system.
Responsibilities
- Develop, enhance and test new/existing interfaces, including developing and enhancing ETL pipelines and design solutions.
- Handle DevOps efforts including CI/CD, scanning, code, performance testing, and test coverage.
- Identify, analyze, and interpret trends or patterns in complex data sets and transform existing ETL logic into AWS and Hadoop platforms.
- Innovate new ways of managing, transforming, and validating data.
- Leverage enterprise-authorized AI coding assist tools to improve code quality, delivery speed, and productivity.
- Establish and enforce guidelines to ensure consistency, quality, and completeness of data assets.
- Apply quality assurance best practices to all work products.
Requirements
- Formal training or certification on software engineering concepts and 2+ years applied experience.
- Experience in AWS Services and Databricks.
- Experience in Athena, Redshift, Glue, Aurora, RDS, S3, Lambda, and EC2.
- Experience in Big Data technologies including Hadoop, Spark Architecture, Spark SQL, Streaming, and Kafka.
- Experience in real-time streaming data.
- Hands-on experience using AI-assisted software development tools and understanding responsible AI use.
- Proficiency in Python and SQL is required.
- Experience with LLMs integration, prompt/context engineering, and AI Agent frameworks.
- Strong experience with UNIX shell scripting.
- Familiarity with relational database environments such as Oracle or SQL Server.
Nice to Have
- Bachelor's degree in a technical or quantitative field.
- Experience in Databricks and Snowflake.
- Experience working in development teams using Agile techniques and Object Oriented development.