Designs and delivers enterprise Azure data platforms, lakehouses, ETL/ELT pipelines, and streaming solutions using Databricks, Spark, Delta Lake, and related Azure services. Leads engineering delivery, mentors team members, establishes technical standards, and collaborates with stakeholders. Responsibilities include data modeling, performance tuning, governance, security, CI/CD, monitoring, observability, and operational readiness across Agile and DevOps environments.
Description and Requirements
We're Hiring: Senior Azure Data Engineer / Data Engineering Lead
Role: Senior Azure Data Engineer / Data Engineering Lead | Experience: 8+ Years | Level: Senior Individual Contributor
About the Role
We are looking for a senior Azure Data Engineering professional who can design, build, and lead delivery of enterprise-scale cloud data platforms. The ideal candidate will bring strong hands-on engineering depth across Azure, Databricks, Spark, Data Lakehouse, and modern data pipelines, while also guiding engineers, collaborating with business stakeholders, and driving high-quality delivery in an Agile and DevOps environment.
What You'll Lead and Deliver
• Modern Data Platform & Lakehouse Engineering:
§ Architect and deliver scalable data lakehouse solutions using Azure Data Lake Storage, Azure Databricks, Delta Lake, Unity Catalog, and Medallion architecture.
§ Design curated data products, data marts, and analytics-ready datasets for business analysts, data scientists, and enterprise reporting teams.
§ Apply strong data modeling practices, partitioning strategies, schema evolution, performance tuning, and cost optimization.
• Data Pipelines, ETL/ELT & Streaming:
§ Build reliable batch and near-real-time pipelines using Azure Databricks, Apache Spark, PySpark, SQL, Azure Data Factory, Synapse, and related Azure services.
§ Implement ingestion frameworks for structured, semi-structured, and unstructured data from multiple enterprise sources.
§ Ensure data quality, lineage, validation, observability, error handling, and reusable pipeline patterns.
• Engineering Leadership:
§ Lead and mentor a team of data engineers, set engineering standards, review designs, and guide implementation decisions.
§ Collaborate with architects, product owners, business stakeholders, data scientists, security, platform, and operations teams.
§ Drive Agile delivery, estimation, sprint planning, technical roadmaps, and continuous improvement across the team.
• DevOps, Security & Governance:
§ Implement CI/CD for data workloads using Azure DevOps or GitHub Actions, including automated testing, deployment, and release governance.
§ Apply secure engineering practices using Microsoft Entra ID, role-based access control, secrets management, and data governance controls.
§ Promote monitoring, alerting, operational readiness, and SRE-aligned practices for production data platforms.
Candidate Profile
• Education: Bachelor's degree in Computer Science, Engineering, Information Technology, Data Engineering, or equivalent practical experience.
• Experience:
§ 8+ years of experience in data engineering, data platform engineering, ETL/ELT, BI, analytics, or cloud data application development.
§ 4+ years of hands-on experience designing and delivering cloud-based data platforms on Microsoft Azure.
§ 2+ years of strong experience with Azure Databricks, Apache Spark, PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
§ Proven experience leading engineers, reviewing architecture/design, owning delivery outcomes, and driving technical excellence.
• Core Azure Skills:
§ Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Dedicated SQL Pool, Cosmos DB, Logic Apps, Azure Monitor, and Application Insights.
§ Experience with Microsoft Entra ID, access control, secure connectivity, key management, and enterprise data governance.
• Azure Databricks Skills:
§ Hands-on expertise in Databricks workspaces, notebooks, jobs/workflows, clusters/serverless compute, Delta tables, Auto Loader, Delta Live Tables or Lakeflow-style declarative pipelines.
§ Strong understanding of Unity Catalog, catalog/schema/table governance, data lineage, access controls, data quality, and lakehouse security practices.
§ Experience optimizing Spark jobs, Delta Lake performance, partitioning, Z-ordering/clustering strategies, workload monitoring, and cost-efficient compute usage.
Skills & Competencies
• Technical Skills:
§ Python, PySpark, SQL, Spark SQL, data modeling, ETL/ELT design, orchestration, data quality, metadata management, and performance tuning.
§ Modern lakehouse patterns including Bronze/Silver/Gold layers, Delta Lake, schema evolution, slowly changing dimensions, and reusable ingestion frameworks.
§ CI/CD, Git, Azure DevOps, automated testing, environment configuration, release pipelines, SonarQube, and secure coding practices.
§ Monitoring and observability using Azure Monitor, Application Insights, logs, alerts, pipeline health checks, and operational dashboards.
• Leadership & Collaboration:
§ Ability to lead engineers, mentor junior team members, influence design decisions, and promote engineering best practices.
§ Strong communication skills with the ability to work across global, multi-cultural teams and translate business needs into scalable technical solutions.
§ Comfortable working in a fast-paced Agile environment with ownership mindset, delivery focus, and continuous improvement culture.
• Certifications Preferred / Add-ons:
§ Microsoft Certified: Azure Data Engineer Associate.
§ Microsoft Certified: Azure Databricks Data Engineer Associate.
§ Databricks Certified Data Engineer Associate or Professional.
§ Azure Solutions Architect, Azure Developer, or relevant cloud/data engineering certifications are a plus.
Why Join Us?
Be part of MetLife's technology transformation journey and help build modern, secure, scalable, and governed data platforms that create meaningful business impact. If you are passionate about Azure, Databricks, data engineering, and leading teams to deliver high-quality solutions, we would love to connect.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
We're Hiring: Senior Azure Data Engineer / Data Engineering Lead
Role: Senior Azure Data Engineer / Data Engineering Lead | Experience: 8+ Years | Level: Senior Individual Contributor
About the Role
We are looking for a senior Azure Data Engineering professional who can design, build, and lead delivery of enterprise-scale cloud data platforms. The ideal candidate will bring strong hands-on engineering depth across Azure, Databricks, Spark, Data Lakehouse, and modern data pipelines, while also guiding engineers, collaborating with business stakeholders, and driving high-quality delivery in an Agile and DevOps environment.
What You'll Lead and Deliver
• Modern Data Platform & Lakehouse Engineering:
§ Architect and deliver scalable data lakehouse solutions using Azure Data Lake Storage, Azure Databricks, Delta Lake, Unity Catalog, and Medallion architecture.
§ Design curated data products, data marts, and analytics-ready datasets for business analysts, data scientists, and enterprise reporting teams.
§ Apply strong data modeling practices, partitioning strategies, schema evolution, performance tuning, and cost optimization.
• Data Pipelines, ETL/ELT & Streaming:
§ Build reliable batch and near-real-time pipelines using Azure Databricks, Apache Spark, PySpark, SQL, Azure Data Factory, Synapse, and related Azure services.
§ Implement ingestion frameworks for structured, semi-structured, and unstructured data from multiple enterprise sources.
§ Ensure data quality, lineage, validation, observability, error handling, and reusable pipeline patterns.
• Engineering Leadership:
§ Lead and mentor a team of data engineers, set engineering standards, review designs, and guide implementation decisions.
§ Collaborate with architects, product owners, business stakeholders, data scientists, security, platform, and operations teams.
§ Drive Agile delivery, estimation, sprint planning, technical roadmaps, and continuous improvement across the team.
• DevOps, Security & Governance:
§ Implement CI/CD for data workloads using Azure DevOps or GitHub Actions, including automated testing, deployment, and release governance.
§ Apply secure engineering practices using Microsoft Entra ID, role-based access control, secrets management, and data governance controls.
§ Promote monitoring, alerting, operational readiness, and SRE-aligned practices for production data platforms.
Candidate Profile
• Education: Bachelor's degree in Computer Science, Engineering, Information Technology, Data Engineering, or equivalent practical experience.
• Experience:
§ 8+ years of experience in data engineering, data platform engineering, ETL/ELT, BI, analytics, or cloud data application development.
§ 4+ years of hands-on experience designing and delivering cloud-based data platforms on Microsoft Azure.
§ 2+ years of strong experience with Azure Databricks, Apache Spark, PySpark, Spark SQL, Delta Lake, and Lakehouse architecture.
§ Proven experience leading engineers, reviewing architecture/design, owning delivery outcomes, and driving technical excellence.
• Core Azure Skills:
§ Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL, Dedicated SQL Pool, Cosmos DB, Logic Apps, Azure Monitor, and Application Insights.
§ Experience with Microsoft Entra ID, access control, secure connectivity, key management, and enterprise data governance.
• Azure Databricks Skills:
§ Hands-on expertise in Databricks workspaces, notebooks, jobs/workflows, clusters/serverless compute, Delta tables, Auto Loader, Delta Live Tables or Lakeflow-style declarative pipelines.
§ Strong understanding of Unity Catalog, catalog/schema/table governance, data lineage, access controls, data quality, and lakehouse security practices.
§ Experience optimizing Spark jobs, Delta Lake performance, partitioning, Z-ordering/clustering strategies, workload monitoring, and cost-efficient compute usage.
Skills & Competencies
• Technical Skills:
§ Python, PySpark, SQL, Spark SQL, data modeling, ETL/ELT design, orchestration, data quality, metadata management, and performance tuning.
§ Modern lakehouse patterns including Bronze/Silver/Gold layers, Delta Lake, schema evolution, slowly changing dimensions, and reusable ingestion frameworks.
§ CI/CD, Git, Azure DevOps, automated testing, environment configuration, release pipelines, SonarQube, and secure coding practices.
§ Monitoring and observability using Azure Monitor, Application Insights, logs, alerts, pipeline health checks, and operational dashboards.
• Leadership & Collaboration:
§ Ability to lead engineers, mentor junior team members, influence design decisions, and promote engineering best practices.
§ Strong communication skills with the ability to work across global, multi-cultural teams and translate business needs into scalable technical solutions.
§ Comfortable working in a fast-paced Agile environment with ownership mindset, delivery focus, and continuous improvement culture.
• Certifications Preferred / Add-ons:
§ Microsoft Certified: Azure Data Engineer Associate.
§ Microsoft Certified: Azure Databricks Data Engineer Associate.
§ Databricks Certified Data Engineer Associate or Professional.
§ Azure Solutions Architect, Azure Developer, or relevant cloud/data engineering certifications are a plus.
Why Join Us?
Be part of MetLife's technology transformation journey and help build modern, secure, scalable, and governed data platforms that create meaningful business impact. If you are passionate about Azure, Databricks, data engineering, and leading teams to deliver high-quality solutions, we would love to connect.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
MetLife Mahārāshtra, IND Office
MetLife Pune, IN Office
EON West LP-II, 2nd & 3rd Floor, Tower D, S.no. 106(P), 107(P), 108(P)/1, Maharashtra, India, 411057
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Develops and maintains automated tests across web, API, and native applications. Applies test methodologies, automation frameworks, CI/CD, test-driven development, Agile practices, and performance testing using tools such as JMeter and BlazeMeter. The role requires strong automation experience in financial services or technology environments and proficiency with Java or TypeScript and Azure DevOps.
Top Skills:
Azure DevopsBlazemeterCi/CdJavaJmeterTest Automation FrameworksTypescript
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Oversee facility soft services, maintenance, vendors, procurement, inventory, invoicing, contracts, preventive maintenance, and compliance. Supervise facilities staff and service providers, manage AMCs, monitor SLAs, coordinate repairs, prepare MIS reports, and support training and stakeholder engagement. Ensure safe, functional, cost-effective, and well-maintained facilities while meeting organizational and statutory standards.
Top Skills:
Electrical SystemsElevatorsFire Safety SystemsHvacPlumbing
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Supports reliability, availability, and performance of critical applications and platforms. Responsibilities include monitoring, incident response, observability, runbook maintenance, scripting and automation, root cause follow-up, postmortems, SLO and SLI adoption, alert improvement, and operational readiness. Collaborates with engineering, cloud, infrastructure, and application teams while using tools such as Kubernetes, Azure, dashboards, logs, and AI-assisted investigation systems.
Top Skills:
ApmAzure Application InsightsAzure DevopsAzure MonitorBashCi/CdDockerElastic/ElkGitGitGrafanaKubernetesLinuxAzurePowershellPrometheusPythonServicenowSplunkSQLTerraform
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
