As a Lead Software Engineer, you will design, develop, and maintain ETL processes, collaborate with stakeholders, optimize data integration solutions, ensure data quality, and mentor junior engineers while staying updated on industry trends.
Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorgan Chase within the Securities Services Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities
- Design, develop, and maintain ETL processes (using Python, AWS) to support data integration and data warehousing solutions.
- Collaborate with data architects, data analysts, and business stakeholders to understand data requirements and translate them into technical specifications.
- Optimize and tune ETL processes (using Python, AWS) for performance and scalability.
- Ensure data quality and integrity through rigorous testing and validation procedures.
- Monitor and troubleshoot ETL processes to resolve issues and ensure timely data availability.
- Develop and maintain documentation for ETL processes, data flows, and data models.
- Mentor and provide guidance to junior ETL engineers and data team members.
- Stay current with industry trends and best practices in data engineering and ETL technologies.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years of applied experience
- Hands-on practical experience in ETL development (using Python, AWS) and data engineering
- Preferred experience with Apache Spark
- Strong SQL skills and experience with relational databases (e.g., Oracle, SQL Server, MySQL)
- Good Debugging and Optimization Capabilities
- Understanding of different data formats like CSV, Parquet and ORC and data sources like HDFS, S3, SFTP, Apache Iceberg etc
- Proficient in all aspects of the Software Development Life Cycle
- Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
- Familiarity with other programming languages such as Java or Scala
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services
Preferred qualifications, capabilities, and skills
- Experience with big data technologies (e.g., Hadoop).
- Knowledge of data governance and data security best practices.
- Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).
Top Skills
Java
Python
Scala
SQL
Similar Jobs at JPMorganChase
Financial Services
As a Lead Software Engineer, you will develop and deliver market-leading technology solutions, enhance application stability, and troubleshoot technical issues. You will also code securely in Java, support various business functions, and contribute to a diverse team culture.
Top Skills:
Java
Financial Services
As a Python Developer Associate, you will lead data science projects, manage deliveries, and provide technical mentorship while developing scalable solutions. Your role involves collaborating with teams to deliver actionable insights and staying current with industry trends.
Top Skills:
Python
Financial Services
As a Software Engineer III, you will design, develop, and maintain secure and scalable software solutions while working within an agile team. You'll be responsible for architecture, problem-solving, and integrating diverse data sets to improve software performance and contribute to community practices.
Top Skills:
Java
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
