Mastercard
Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow
Be an Early Applicant
Manage multiple scrum teams and lead software development efforts in Big Data projects, ensuring high-quality and timely software delivery.
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow
Who is Mastercard?
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Overview:
The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend.
Role:
• Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner. • Successfully lead definition, development and delivery of major cross-department initiatives with broad scope and long-term business implications. • Provide technical leadership and direction to software development teams in the development of services and capabilities, Understand, implement and enforce Software development standards and engineering principles in the Big Data space.• Work closely with product and architecture teams on product definition, technical design, and overall execution for the team.• Ensure the project or effort is adequately staffed; trained and managed. Ensure personnel have appropriate skills and behaviors; and effectively communicate performance results; as necessary, managing each effort within approved manpower and budget guidelines• Technically manage and drive deliveries from scrum teams that will be responsible implementing, documenting, testing, maintaining and supporting applications in adherence with industry best practices specially in Big Data space.• Developing high quality, secure, scalable solutions based on technical requirements specifications and design artifacts within expected time and budget.• Work across on-premises and cloud environments (AWS, Azure, Databricks).• Design & development of high quality data driven applications and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO.• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.• Expertise to guide team in using SDLC tools such Git-based version control systems, CI/CD pipelines using Jenkins, Checkmarx, test automation tools etc• Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews• Good to have experience in developing enterprise solutions (standalone applications, services & SDK) using J2EE, JDBC (SQL & NoSQL) related technologies like Spring & Spring framework, micro services on Cloud.• Integrating content feeds via API, JSON, XML, and RSS from both internal and external sources.• supporting internal and external users of the applications/systems, performing production incident management and participating in on-call escalation pager support rotation.• Documenting application components for support and training materials for MasterCard Quality Assurance and Quality Control processes.
About You:• Hands-on technical leader who brings considerable experience doing application development and managing teams by using a broad range of technologies and dives deep into everything team does.• Demonstrate leadership, ethics and values to generate high trust with team, peers, and management.• Must be high-energy, detail-oriented and proactive with the ability to function under pressure in an independent environment. • Must provide the necessary skills to have a high degree of initiative and self-motivation with a willingness and ability to learn and take on challenging opportunities. • Strong communication skills - both verbal and written - with strong relationship building, collaborative skills and organizational skills. • Must be obsessed with results, and effectively communicate objectives and how success will be measured to the team and other stakeholders.• Have strong decision-making skills, lead retrospection and continually improve as a result. • Understands how to guide an engineer's career including performance evaluation, coaching, and motivation.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Manager, Data Engineer - Apache Nifi, Python, PySpark, Hadoop, Cloudera platforms, and Airflow
Who is Mastercard?
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Overview:
The Mastercard Account Level Management (ALM) platform empowers real-time card level decisioning. As consumers progress along their life stages as card holders, with increasing disposable income and more refined preferences, ALM provides services to issuers so they can effectively offer more relevant benefits and rewards at each stage, to drive loyalty and spend.
Role:
• Managing multiple scrum teams of Software developers and testers to develop quality software solutions in a timely and cost-effective manner. • Successfully lead definition, development and delivery of major cross-department initiatives with broad scope and long-term business implications. • Provide technical leadership and direction to software development teams in the development of services and capabilities, Understand, implement and enforce Software development standards and engineering principles in the Big Data space.• Work closely with product and architecture teams on product definition, technical design, and overall execution for the team.• Ensure the project or effort is adequately staffed; trained and managed. Ensure personnel have appropriate skills and behaviors; and effectively communicate performance results; as necessary, managing each effort within approved manpower and budget guidelines• Technically manage and drive deliveries from scrum teams that will be responsible implementing, documenting, testing, maintaining and supporting applications in adherence with industry best practices specially in Big Data space.• Developing high quality, secure, scalable solutions based on technical requirements specifications and design artifacts within expected time and budget.• Work across on-premises and cloud environments (AWS, Azure, Databricks).• Design & development of high quality data driven applications and scalable data pipelines using spark, Scala/Python/Java on Hadoop or object storage like MinIO.• Experience of working with Databases like Oracle, Netezza and have strong SQL knowledge.• Expertise to guide team in using SDLC tools such Git-based version control systems, CI/CD pipelines using Jenkins, Checkmarx, test automation tools etc• Proficient in working within an Agile/Scrum framework, including creating user stories with well-defined acceptance criteria, participating in sprint planning and reviews• Good to have experience in developing enterprise solutions (standalone applications, services & SDK) using J2EE, JDBC (SQL & NoSQL) related technologies like Spring & Spring framework, micro services on Cloud.• Integrating content feeds via API, JSON, XML, and RSS from both internal and external sources.• supporting internal and external users of the applications/systems, performing production incident management and participating in on-call escalation pager support rotation.• Documenting application components for support and training materials for MasterCard Quality Assurance and Quality Control processes.
About You:• Hands-on technical leader who brings considerable experience doing application development and managing teams by using a broad range of technologies and dives deep into everything team does.• Demonstrate leadership, ethics and values to generate high trust with team, peers, and management.• Must be high-energy, detail-oriented and proactive with the ability to function under pressure in an independent environment. • Must provide the necessary skills to have a high degree of initiative and self-motivation with a willingness and ability to learn and take on challenging opportunities. • Strong communication skills - both verbal and written - with strong relationship building, collaborative skills and organizational skills. • Must be obsessed with results, and effectively communicate objectives and how success will be measured to the team and other stakeholders.• Have strong decision-making skills, lead retrospection and continually improve as a result. • Understands how to guide an engineer's career including performance evaluation, coaching, and motivation.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard's security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
Top Skills
Airflow
Apache Nifi
AWS
Azure
Checkmarx
Cloudera
Databricks
Git
Hadoop
J2Ee
Jdbc
Jenkins
Netezza
NoSQL
Oracle
Pyspark
Python
Spring
SQL
Mastercard Pune, Mahārāshtra, IND Office




Poona Club Road, Pune, Maharashtra, India, 411001
Similar Jobs at Mastercard
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Senior BizOps Engineer ensures platform stability and health, supports developers in creating resilient products, and manages production activities for optimal customer experience.
Top Skills:
AutomationComplianceData EngineeringMonitoringRisk ManagementSite Reliability Engineering
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Manager of Software Engineering is responsible for leading development teams, software design and delivery, managing budgets, and improving team performance.
Top Skills:
CC++
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Develop high-quality Java Full Stack applications, collaborate with Product Owners on UI design, and engage in Agile processes. Support testing and adhere to best practices in software development.
Top Skills:
AngularApacheChefEclipseGradleIntellijJavaJenkinsMavenOracleReactSonarqubeSpringSQLTomcatVisual Studio
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.