The Senior Lead Software Engineer will manage Databricks platform, drive migrations, optimize infrastructure, and mentor teams to enhance technology products.
Job Description
Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.
As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking Risk Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.
Job responsibilities
Required qualifications, capabilities, and skills
Preferred qualifications, capabilities, and skills
Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.
As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer & Community Banking Risk Team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.
Job responsibilities
- Plan and deliver SAS-to-PySpark migrations on Databricks (cutover, validation, rollback).
- Build and maintain automated conversion utilities and CI/CD pipelines.
- Own data conversion and migration (schema mapping, quality checks, reconciliation, lineage).
- Run office hours for user communities, coach engineers, and drive best practices and standards.
- Optimize Databricks infrastructure (clusters, policies, performance, and cost).
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years applied experience. In addition, 2 + years of experience leading technologists to manage and solve complex technical items within your domain of expertise
- Hands On experience in data/analytics engineering; 5+ years leading large-scale Pyspark/Databricks programs.
- Proven SAS-to-PySpark migration delivery into production with measurable outcomes.
- Track record in data migration, quality assurance, and operational readiness
Preferred qualifications, capabilities, and skills
- Deep PySpark expertise (performance tuning, ETL functionality).
- Databricks platform proficiency (Unity Catalog, SQL Warehouses, job/cluster policies, MLflow basics).
- Automation and CI/CD (build/deploy pipelines, release management).
- Cloud fundamentals (AWS S3, IAM, networking, monitoring)
Top Skills
Aws S3
Ci/Cd
Databricks
Iam
Pyspark
SAS
Similar Jobs at JPMorganChase
Financial Services
As a Lead Software Engineer, you will develop and maintain software solutions, drive technology implementation, and enhance operational stability while leading a team focused on innovation and agile methodologies.
Top Skills:
AthenaAWSDockerEmrGlueJavaKinesisLambdaPythonRedshiftS3Scala
Financial Services
The role involves designing and delivering secure technology products, developing scalable software solutions, analyzing large datasets, and contributing to team culture.
Top Skills:
AWSC++CassandraDockerGCPJavaKafkaKubernetesMs AzurePythonScala
Financial Services
The Applied AI ML Lead develops and maintains machine learning pipelines and infrastructure, collaborates with teams to ensure compliance, and enhances operational excellence.
Top Skills:
AirflowDockerEc2EcsEmrJavaKubeflowKubernetesPythonRaySagemakerSparkVertex Ai
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
