As a Lead Software Engineer, you will design and implement scalable data pipelines using Python and PySpark on AWS, manage a team of data engineers, collaborate with stakeholders, ensure data quality, and continuously improve technical solutions.
Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible. As a Lead Software Engineer at JPMorgan Chase within the Asset and Wealth Management, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities
- Lead the design, development, and implementation of scalable data pipelines and ETL batches using Python/PySpark on AWS.
- Execute standard software solutions, design, development, and technical troubleshooting
- Use infrastructure as code to build applications to orchestrate and monitor data pipelines, create and manage on-demand compute resources on cloud programmatically, create frameworks to ingest and distribute data at scale.
- Add to team culture of diversity, equity, inclusion, and respect.
- Manage and mentor a team of data engineers, providing guidance and support to ensure successful product delivery and support.
- Collaborate proactively with stakeholders, users and technology teams to understand business/technical requirements and translate them into technical solutions.
- Optimize and maintain data infrastructure on cloud platform, ensuring scalability, reliability, and performance.
- Implement data governance and best practices to ensure data quality and compliance with organizational standards.
- Monitor and troubleshoot application and data pipelines, identifying and resolving issues in a timely manner.
- Stay up-to-date with emerging technologies and industry trends to drive innovation and continuous improvement.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years applied experience
- Demonstrable hands-on experience in Python and PySpark.
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Proven experience with cloud platforms such as AWS, Azure, or Google Cloud.
- Good understanding of data modeling, data architecture, ETL processes, and data warehousing concepts.
- Experience with big data technologies and services like AWS EMRs, Redshift, Lambda, S3.
- Excellent communication skills to work effectively with stakeholders, partner teams, and to translate technical concepts into business terms.
- Proven experience with efficient Cloud DevOps practices and CI/CD tools like Jenkins/Gitlab, for data engineering platforms.
- Good knowledge of SQL and NoSQL databases, including performance tuning and optimization.
- Strong analytical skills to troubleshoot issues and optimize data processes, working independently and collaboratively.
- Experience in leading and managing a team of engineers, with a proven track record of successful project delivery.
Preferred qualifications, capabilities, and skills
- Knowledge of machine learning concepts, language models and cloud-native MLOps pipelines and frameworks is a big plus.
- AWS Certifications in data engineering and machine learning is a plus.
- Familiarity with data visualization tools and data integrations.
Top Skills
Pyspark
Python
Similar Jobs at JPMorganChase
Financial Services
As a Lead Software Engineer, you will develop and deliver market-leading technology solutions, enhance application stability, and troubleshoot technical issues. You will also code securely in Java, support various business functions, and contribute to a diverse team culture.
Top Skills:
Java
Financial Services
As a Python Developer Associate, you will lead data science projects, manage deliveries, and provide technical mentorship while developing scalable solutions. Your role involves collaborating with teams to deliver actionable insights and staying current with industry trends.
Top Skills:
Python
Financial Services
As a Software Engineer III, you will design, develop, and maintain secure and scalable software solutions while working within an agile team. You'll be responsible for architecture, problem-solving, and integrating diverse data sets to improve software performance and contribute to community practices.
Top Skills:
Java
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
