Designs and deploys scalable Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake across medallion layers. Builds HR data models, source-to-target mappings, reconciliation controls, governance, lineage, documentation, and data quality processes. Modernizes legacy Informatica and SQL integrations, including Oracle HCM feeds. Collaborates with distributed agile teams, mentors junior engineers, and supports production cutovers for sensitive employee data.
Description and Requirements
Key Responsibilities
• Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, spanning Bronze/Silver/Gold (medallion) layers for HR data integration and analytics.
• Build data models - logical, physical, dimensional, and integration - and maintain source-to-target mappings for workforce, organization, employee, position, job, and related HR domains.
• Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns, including inbound Oracle HCM feeds and outbound HR data files.
• Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling, and audit controls into pipelines.
• Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable.
• Produce production-ready documentation - technical designs, runbooks, data dictionaries, and support handoffs - for maintainable, observable, cost-aware solutions.
• Collaborate within a distributed delivery team, participate in agile ceremonies, mentor junior engineers, and communicate progress, blockers, and risks clearly.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or related field, with 7+ years of data engineering, ETL, or data platform experience.
• Azure Databricks & Apache Spark: 3+ years hands-on building Delta Lake pipelines with PySpark, Spark SQL, and SQL across a medallion architecture.
• Data modeling & integration: Strong logical/physical/dimensional modeling plus source-to-target mapping, reconciliation, and production cutover support.
• AI-assisted engineering: Proficiency using AI/Copilot tooling to accelerate development, code conversion, and documentation.
• Practical, delivery-focused work style, comfortable turning ambiguous legacy logic into clean target-state designs within a highly governed environment.
• Strong written and verbal communication, with the ability to overlap U.S. Eastern Time for key meetings, design reviews, and issue resolution.
Preferred Qualifications
• Suggested 3+ years modernizing legacy ETL (Informatica-to-Databricks) or building metadata-driven, configuration-driven data frameworks.
• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog, and Git-based CI/CD.
• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, workforce analytics, and consumption via Power BI, Crunchr, or similar.
• Experience supporting regulated, sensitive employee data in insurance, financial services, or HR technology.
• Detail-oriented, collaborative, and comfortable working independently against offshore delivery expectations while staying aligned to MetLife leads.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
Key Responsibilities
• Design, develop, test, and deploy scalable pipelines using Databricks, PySpark, Spark SQL, and Delta Lake, spanning Bronze/Silver/Gold (medallion) layers for HR data integration and analytics.
• Build data models - logical, physical, dimensional, and integration - and maintain source-to-target mappings for workforce, organization, employee, position, job, and related HR domains.
• Migrate legacy GDC integrations by re-engineering Informatica, SQL, and stored-procedure logic into modern Databricks patterns, including inbound Oracle HCM feeds and outbound HR data files.
• Validate output parity through reconciliation, parallel runs, and source-to-target checks, and build automated data quality, exception handling, and audit controls into pipelines.
• Apply enterprise governance, security, privacy, and role-based access expectations to sensitive HR data, capturing lineage and metadata where applicable.
• Produce production-ready documentation - technical designs, runbooks, data dictionaries, and support handoffs - for maintainable, observable, cost-aware solutions.
• Collaborate within a distributed delivery team, participate in agile ceremonies, mentor junior engineers, and communicate progress, blockers, and risks clearly.
Required Qualifications
• Bachelor's degree in Computer Science, Engineering, or related field, with 7+ years of data engineering, ETL, or data platform experience.
• Azure Databricks & Apache Spark: 3+ years hands-on building Delta Lake pipelines with PySpark, Spark SQL, and SQL across a medallion architecture.
• Data modeling & integration: Strong logical/physical/dimensional modeling plus source-to-target mapping, reconciliation, and production cutover support.
• AI-assisted engineering: Proficiency using AI/Copilot tooling to accelerate development, code conversion, and documentation.
• Practical, delivery-focused work style, comfortable turning ambiguous legacy logic into clean target-state designs within a highly governed environment.
• Strong written and verbal communication, with the ability to overlap U.S. Eastern Time for key meetings, design reviews, and issue resolution.
Preferred Qualifications
• Suggested 3+ years modernizing legacy ETL (Informatica-to-Databricks) or building metadata-driven, configuration-driven data frameworks.
• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog, and Git-based CI/CD.
• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, workforce analytics, and consumption via Power BI, Crunchr, or similar.
• Experience supporting regulated, sensitive employee data in insurance, financial services, or HR technology.
• Detail-oriented, collaborative, and comfortable working independently against offshore delivery expectations while staying aligned to MetLife leads.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
MetLife Mahārāshtra, IND Office
MetLife Pune, IN Office
EON West LP-II, 2nd & 3rd Floor, Tower D, S.no. 106(P), 107(P), 108(P)/1, Maharashtra, India, 411057
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead Oracle HCM Cloud implementations and provide hands-on configuration across Core HR, Performance Management, Learning, and Analytics. Translate business requirements into functional and technical designs, develop Fast Formulas, HCM Extracts, OTBI and BI Publisher reports, and support integrations using HDL, HSDL, REST, and SOAP. Perform testing, production support, troubleshooting, documentation, and stakeholder collaboration throughout the implementation lifecycle.
Top Skills:
Agent BuilderBi PublisherCore HrFast FormulasHcm AnalyticsHcm ExtractsHdlHsdlLearningOracle Hcm CloudOtbiPerformance ManagementRestSoapUnix Shell ScriptingVb
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead Oracle HCM Cloud implementations focused on Benefits and HR Analytics. Gather requirements, design and configure solutions, develop Fast Formulas, HCM Extracts, OTBI and BI Publisher reports, and build integrations using HDL, HSDL, REST and SOAP. Support testing, deployment, production troubleshooting, documentation, and process improvements while collaborating with HRIS, IT, and business stakeholders. Additional work may include Core HR, Absence Management, Compensation, Payroll, and Oracle Agent Builder automation.
Top Skills:
Agent BuilderBi PublisherFast FormulasHcm ExtractsHdlHsdlOracle Hcm CloudOracle Hr AnalyticsOtbiRestSoapUnix Shell Scripting
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs, builds, and maintains scalable batch and real-time data pipelines across Azure and on-premises environments. Develops data lakes, warehouses, marts, and Medallion architectures using Spark and modern big data technologies. Ensures pipeline reliability, performance, security, governance, privacy, and data quality while collaborating with business, technology, analytics, DevOps, and data governance teams. Supports platform modernization and continuous improvement.
Top Skills:
Apache NifiSparkAzureAzure Data FactoryAzure DevopsAzure Event HubAzure FunctionsAzure Synapse AnalyticsCi/CdCosmos DbDatabricksEltETLGenerative AiGitHadoopHbaseHiveMongoDBPythonScalaSQLUnix Shell Scripting
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
