Software Engineer III - LLM / Gen AI Developer + AWS

Role Overview

As a Software Engineer III Python Developer + LLM / Gen AI at JPMorgan Chase within Commercial & Investment Bank - Global Banking, you'll serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Responsibilities

• Executes software solutions which integrate Gen AI models with Enterprise workflows, including design, development, and technical troubleshooting. Demonstrates the ability to think beyond routine or conventional approaches to build solutions or break down technical problems.
• Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
• Builds data pipelines that clean, transform, and aggregate data from disparate sources.
• Creates secure and high-quality production code and maintains algorithms that integrate seamlessly with appropriate systems.
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development.
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems.
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture.
• Contributes to software engineering communities of practice and events that explore new and emerging technologies.

Requirements

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Strong hands-on expertise with Python is a must-have, with experience in Python frameworks like Django, Flask or FastAPI.
• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.
• Software development experience and working experience with LLMs, Gen AI solution integration, RAG solutions.
• Hands-on practical experience in system design, application development, including building data pipelines, testing, and operational stability.
• Experience in AI agents frameworks, Langchain, and LangGraph. Experience working on document-based Gen AI use cases.
• Proficient in Python programming and experience with ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face).
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages and Familiarity with cloud-based AI services such as AWS, Azure, or GCP.
• Solid understanding of agile methodologies, application resiliency, and security and experience working with CI/CD pipelines.
• Demonstrated knowledge of software applications and technical processes within ML and Cloud technologies and Overall knowledge of the Software Development Life Cycle.

Preferred Qualifications

• Hands-on experience in building Gen AI solutions for the enterprise.
• Familiarity with Java, shell scripting is preferred.
• Experience building solutions using AWS/similar cloud technologies.
• Certifications in cloud technologies.