Leads the design, development, and maintenance of enterprise-scale batch and real-time data pipelines across Azure and on-premises environments. Builds scalable ingestion and processing frameworks, optimizes reliability and performance, and ensures data quality, governance, security, and compliance. Provides solution architecture, technical leadership, stakeholder collaboration, mentoring, and engineering standards adoption across complex programs.
Description and Requirements
Data Engineer
The Opportunity
As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data solutions that support enterprise-wide analytics and business intelligence initiatives. The role requires deep expertise in Big Data technologies, cloud platforms, and modern data engineering practices. In addition to technical leadership, you will play a key role in mentoring and developing Data & Analytics talent while driving delivery excellence across complex programs.
Key Responsibilities
Primary Requirements
A. Technical Skills
B. Additional Requirements
Good to Have
Qualifications
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
Data Engineer
The Opportunity
As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data solutions that support enterprise-wide analytics and business intelligence initiatives. The role requires deep expertise in Big Data technologies, cloud platforms, and modern data engineering practices. In addition to technical leadership, you will play a key role in mentoring and developing Data & Analytics talent while driving delivery excellence across complex programs.
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT pipelines on Azure cloud and on-premises platforms for batch and real-time data processing.
- Build scalable data ingestion and processing frameworks to handle structured, semi-structured, and unstructured datasets.
- Solve complex business problems by leveraging data engineering best practices and advanced technologies.
- Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, performance, and scalability.
- Ensure adherence to data quality, governance, security, privacy, and compliance standards.
- Collaborate with business stakeholders, architects, data scientists, governance teams, DevOps teams, and analytics partners to deliver business value.
- Lead solution design discussions, technical estimations, architecture reviews, and implementation strategies.
- Provide technical guidance and mentorship to engineering teams while fostering continuous learning and capability development.
- Drive adoption of engineering standards, reusable frameworks, and best practices across programs.
Primary Requirements
A. Technical Skills
- Strong experience with SQL, Python, and/or Scala.
- Hands-on expertise in Big Data technologies including Apache Spark, Hadoop, and Hive.
- Experience designing and developing enterprise-scale ETL/ELT pipelines.
- Expertise in Azure Data Engineering ecosystem:
- Azure Data Factory (ADF)
- Azure Synapse Analytics
- Azure Databricks
- Azure Event Hub
- Azure Functions
- Experience with NoSQL and Distributed Databases such as Cosmos DB and HBase.
- Strong understanding of Data Warehouses, Data Lakes, and Data Marts.
- Experience implementing Medallion Architecture and modern data design patterns.
- Expertise in data performance tuning, optimization, and quality validation.
- Experience building both real-time and batch processing pipelines, including Spark Streaming.
B. Additional Requirements
- Excellent communication and stakeholder management skills.
- Strong analytical and structured problem-solving capabilities.
- Proven experience in solution architecture, estimation, and technical leadership.
- Ability to effectively communicate technical concepts through storytelling and presentations.
- Experience managing relationships with business partners and senior stakeholders.
- Demonstrated people leadership experience, including coaching, mentoring, talent development, and engagement.
Good to Have
- Experience with DevOps and CI/CD practices using Git and Azure DevOps.
- Unix/Linux shell scripting expertise.
- Experience with MongoDB and Apache NiFi.
- Understanding of Lambda and Kappa architecture patterns.
- Exposure to Generative AI technologies, tools, and use cases.
- Banking, Financial Services, and Insurance (BFSI) domain experience.
Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent educational qualification.
- 12-14+ years of relevant experience in Data Engineering, Big Data, and Cloud technologies.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
MetLife Mahārāshtra, IND Office
MetLife Pune, IN Office
EON West LP-II, 2nd & 3rd Floor, Tower D, S.no. 106(P), 107(P), 108(P)/1, Maharashtra, India, 411057
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs, builds, and maintains scalable batch and real-time data pipelines across Azure and on-premises environments. Develops data lakes, warehouses, marts, and Medallion architectures using Spark and modern big data technologies. Ensures pipeline reliability, performance, security, governance, privacy, and data quality while collaborating with business, technology, analytics, DevOps, and data governance teams. Supports platform modernization and continuous improvement.
Top Skills:
Apache NifiSparkAzureAzure Data FactoryAzure DevopsAzure Event HubAzure FunctionsAzure Synapse AnalyticsCi/CdCosmos DbDatabricksEltETLGenerative AiGitHadoopHbaseHiveMongoDBPythonScalaSQLUnix Shell Scripting
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and delivers scalable data engineering solutions across Azure and on-premises environments. Builds batch and real-time ETL/ELT pipelines, data lakes, warehouses, marts, and streaming platforms using Spark and related Big Data technologies. Leads architecture, technical design, optimization, governance, and end-to-end implementation while ensuring quality, security, reliability, and performance. Collaborates with cross-functional stakeholders, mentors data engineers, and communicates technical recommendations to business and technology audiences.
Top Skills:
Apache NifiSparkAzureAzure Data FactoryAzure DatabricksAzure DevopsAzure Event HubsAzure FunctionsAzure Synapse AnalyticsCi/CdCosmos DbData LakesData MartsData WarehousesEltETLGitHadoopHbaseHiveKafkaMedallion ArchitectureMongoDBNoSQLPythonScalaSQLUnix Shell Scripting
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Leads quality engineering and test automation for insurance applications, APIs, mobile, web, data-intensive, and AI/ML systems. Designs test strategies, frameworks, dashboards, and acceptance criteria; executes functional, regression, integration, performance, and end-to-end testing; investigates defects; reviews automation code; and drives quality improvements across Agile, DevOps, and geographically distributed teams.
Top Skills:
Ai AgentsAzure DevopsCi/CdDevsecopsGitLarge Language ModelsMicrosoft CopilotPlaywrightPrompt EngineeringRetrieval-Augmented GenerationTosca
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
