Lead Data Engineer – Transfer Solutions

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Lead Data Engineer – Transfer Solutions

Who is Mastercard?
Mastercard is a global technology company in the payments industry. We work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible.
Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.
Our decency quotient, or DQ, drives our culture and everything we do inside and outside of our company. With connections across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.
Team Overview:
Transfer Solutions is responsible for driving Mastercard’s expansion into new payment flows such as Disbursements & Remittances. The team is working on creating a market-leading money transfer proposition, Mastercard Move, to power the next generation of payments between people and businesses, whether money is moving domestically or across borders, by delivering the ability to pay and get paid with choice, transparency, and flexibility.
The Product & Engineering teams within Transfer Solutions are responsible for designing, developing, launching, and maintaining products and services designed to capture these flows from a wide range of Customer segments. By addressing Customer pain points for domestic and cross-border transfers, the goal is to scale Mastercard’s Disbursements & Remittances business, trebling volume over the next 4 years.

If you would like to be part of a global, cross-functional team delivering a highly visible, strategically important initiative in an agile way, this role will be attractive to you.
• Do you like to be part of a team that is creating and executing strategic initiatives centered around digital payments?
• Do you look forward to developing and engaging with high performant diverse teams around the globe?
• Would you like to be part of a highly visible, strategically important global engineering organization?
The Role:
We are looking for an experienced Data Engineer to design and develop advanced data migration pipelines from traditional OLTP databases (e.g., Oracle) to modern big data platforms such as Cloudera and Databricks. The ideal candidate will possess expertise in technologies such as Python, Java, Spark, and NiFi, along with a proven track record in managing data pipelines for tasks including initial snapshot loading, building Change Data Capture (CDC) pipelines, exception management, reconciliation, data security, and retention. This role also demands proficiency in data modeling, cataloging, taxonomy creation, and ensuring robust data provenance and lineage to support governance and compliance requirements.
Key Responsibilities:
• Design, develop, and optimize data migration pipelines from OLTP databases like Oracle to big data platforms, including Cloudera CDP/CDH and Databricks.
• Build scalable ETL workflows using tools like Python, Scala, Apache Spark, and Apache NiFi to support initial snapshots, CDC, exception handling, and reconciliation processes.
• Implement data security measures, such as encryption, access controls, and compliance with data retention policies, across all migration pipelines.
• Develop and maintain data models, taxonomy structures, and cataloging systems to ensure logical organization and easy accessibility of data.
• Establish data lineage and provenance to ensure traceability and compliance with governance frameworks.
• Collaborate with cross-functional teams to understand data migration requirements, ensuring high-quality and timely delivery of solutions.
• Monitor and troubleshoot data pipelines to ensure performance, scalability, and reliability.
• Stay updated on emerging technologies in data engineering and big data ecosystems, proposing improvements to existing systems and processes.
Required Skills and Qualifications:
• 10+ years of experience in data engineering, with at least 2 years in a leadership or technical lead role.
• Proficiency in OLTP databases, particularly Oracle, and data egress techniques.
• Strong programming skills in Python, Scala and Java.
• Expertise in Apache Spark, Flink, Kafka and data integration tools like Apache NiFi.
• Hands-on experience with Cloudera Data Platform CDP/CDH, Apache Ozone
• Familiarity with cloud-based big data ecosystems such as AWS Databrick, S3, Glue etc
• Familiarity with patterns such as Medallion, data layers, datalake, datawarehouse, experience in building scalable ETL pipeline, optimizing data workflows, leveraging platforms to integrate transform, and store large datasets.
• Knowledge of data security best practices, including encryption, data masking, and role-based access control.
• Exceptional problem-solving and analytical abilities
• Strong communication and leadership skills, with the ability to navigate ambiguity and collaborate effectively across diverse teams.Optional – Awareness on regulatory compliance requirements for data handling and privacy
• Education: Bachelor’s or Master’s degree in Computer Science

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard’s security policies and practices;

• Ensure the confidentiality and integrity of the information being accessed;

• Report any suspected information security violation or breach, and

• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.