Mastercard Logo

Mastercard

Lead Data Engineer

Reposted 5 Days Ago
Be an Early Applicant
Pune, Maharashtra
Senior level
Pune, Maharashtra
Senior level
Lead Data Engineer responsible for the design and maintenance of data systems, guiding a team in data integrations, transformations, and optimizing database technologies.
The summary above was generated by AI

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Lead Data Engineer

Overview
This position is for Lead Data Engineer in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization. This key individual will work closely with Data Architects to design and implement solutions and insure successful implementations.
Role
• Leads initiatives to build and maintain database technologies, environments, and applications, seeking opportunities for improvements and efficiencies
• Architects internal data solutions as part of the full stack to include data modelling, integration with file based as well as event driven upstream systems
• Writes SQL statement procedures to optimize SQL execution and query development
• Effectively utilizes various tools such as Spark (Scala, Python), Nifi, Spark streaming, Informatica for data ETL,
• Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables
• Leads database security posture, which includes proactively identifying security risks and implementing both risk mitigation plans and control functions
• Oversees the resolution of chronic complex problems to prevent future data performance issues
• Supports process improvement efforts to identify and test opportunities for automation and/or reduction in time to deployment
• Responsible for complex design (in conjunction with Data Architects), development, and performance and system testing, and provides functional guidance, advice to experienced engineers
• Mentors junior staff by providing training to develop technical skills and capabilities across the team
All about you
• Experience developing a specialization in a particular functional area (e.g., modeling, data loads, transformations, replication, performance tuning, logical and physical database design, performance and troubleshooting, data replication, backup and recovery, and data security) leveraging Apache Spark, Nifi, Databricks, Snowflake, Informatica, streaming solutions.
• Experience leading a major work stream or multiple smaller work streams for a large domain initiative, often providing technical guidance and advice to project team members
• Experience creating deliverables within the global database technology domains and sub-domains, supporting cross-functional leaders in the technical community to derive new solutions
• Experience supporting automation and/or cloud delivery effort; may perform financial and cost analysis
• Experience in database architecture or other relevant IT experience
• Experience in leading business system application and database architecture design, influencing technology direction in range of breadth of IT areas

Corporate Security Responsibility


All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

  • Abide by Mastercard’s security policies and practices;

  • Ensure the confidentiality and integrity of the information being accessed;

  • Report any suspected information security violation or breach, and

  • Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.




Top Skills

Databricks
Informatica
Nifi
Python
Scala
Snowflake
Spark
SQL

Mastercard Pune, Mahārāshtra, IND Office

Poona Club Road, Pune, Maharashtra, India, 411001

Similar Jobs

3 Hours Ago
Hybrid
Pune, Maharashtra, IND
Expert/Leader
Expert/Leader
Fintech • Information Technology • Logistics • Payments • Analytics • Business Intelligence • Generative AI
The Lead Software Engineer - Data at Coupa will architect, design, and optimize data solutions, ensuring data integrity and scalability while mentoring engineers and collaborating cross-functionally.
Top Skills: AirflowAWSAzkabanAzureCassandraEc2EmrGCPJavaKafkaLuigiPostgresPythonRdsRedshiftScalaSparkSQL
6 Days Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
As a Lead Software Engineer, you'll design, develop, and enhance software solutions, manage AWS services, and lead technical evaluations while promoting a collaborative culture.
Top Skills: AngularjsAthenaAWSCi ToolsEc2EcsEmrGitHadoopHibernateHTML5J2EeJavaJavaScriptJIRAKafkaLambdaMavenMicroservicesMskNode.jsNoSQLOpen SearchOracle DbRdsReactS3SparkSpringSQL
Yesterday
Pune, Maharashtra, IND
Senior level
Senior level
Payments
Lead the design and development of data pipelines, collaborate with data scientists, and mentor junior engineers within the Advanced Analytics team at Mastercard.
Top Skills: AirflowAWSAzureDatabricksHadoopHiveImpalaNifiOoziePythonScalaScoopSparkSQL

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account