Lead Software Engineer - Data

Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorgan Chase within the Commercial and Investment Bank - Payments Technology team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities

• Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
• Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture
• Contributes to software engineering communities of practice and events that explore new and emerging technologies
• Provides guidance to immediate team of software engineers on daily tasks and activities
• Sets the overall guidance and expectations for team output, practices, and collaboration
• Anticipates dependencies with other teams to deliver products and applications in line with business requirements
• Manages stakeholder relationships and the team's work in accordance with compliance standards, service level agreements, and business requirements
• Creates a culture of diversity, equity, inclusion, and respect for the team members and prioritizes diverse representation

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Hands on experience in data mapping, data architecture, and data modeling on Databricks
• Extensive experience in AWS, Design, implementation, and maintenance of data pipelines using Python, pyspark on Databricks
• Proficient in Python, and PySpark, able to write and execute complex queries to perform curation and build views required by end users (single and multi-dimensional)
• Extensive experience in Databricks Data engineering (Job Runs, Data Ingestion and Delta Live Tables, Spark Streaming)
• Experienced in standing up and maintaining EC2 instances, Kubernetes clusters and Lambda services
• Experience in building Notebooks with complex code structures and debugging failed jobs.
• Proven experience in performance and tuning to ensure jobs are running at optimal levels and no performance bottleneck
• Proven ability to deliver high quality features into production system in a rapid paced, iterative development environment.

Preferred qualifications, capabilities, and skills

• Exposure to cloud technologies