Develop and maintain Azure Databricks data pipelines using PySpark, Spark SQL, SQL, and Delta Lake. Support Informatica-to-Databricks modernization and HR data integrations, build source-to-target mappings and dimensional models, perform profiling, testing, reconciliation, and defect resolution, and create technical documentation. Apply data governance and access controls through Unity Catalog, participate in agile ceremonies and code reviews, and escalate risks while working under senior direction.
Description and Requirements
Key Responsibilities
• Develop and maintain assigned data pipelines using Azure Databricks, PySpark, Spark SQL, SQL, and Delta Lake, building Bronze/Silver/Gold objects to the program's medallion standards.
• Assist with converting legacy Informatica mappings, SQL, and stored procedures into Databricks processing, and support migration of inbound/outbound HR integrations (including Oracle HCM feeds).
• Implement source-to-target mappings and transformation specs, and help build logical/physical, dimensional, and analytics-ready models for HR data domains under senior direction.
• Perform data profiling, unit testing, and defect resolution; build data-quality and reconciliation checks and compare legacy vs. target-state outputs during parallel runs.
• Produce clear technical documentation - mappings, data dictionaries, test cases, runbooks, and deployment instructions - following established naming, repository, and version-control standards.
• Follow MetLife requirements for handling sensitive HR data, applying approved access-control, classification, and governance practices via Unity Catalog and related tooling.
• Participate in agile ceremonies, incorporate code-review feedback, escalate unclear requirements and risks to the Senior Data Engineer, and provide overlap with U.S. Eastern Time.
Required Qualifications
• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related discipline (or equivalent practical experience), with 2+ years in data engineering, ETL, or data-platform delivery.
• Azure Databricks & Spark: 1+ year of practical exposure to Spark, PySpark, Databricks, or a comparable cloud environment, plus working experience with Python and SQL.
• Data fundamentals: Foundational understanding of ETL/ELT, Delta Lake, medallion architecture, data modeling (keys, relationships, normalization, dimensions), and source-to-target mappings.
• AI-assisted engineering: Willingness to use AI/Copilot tooling to accelerate development, testing, and documentation.
• Curious, detail-oriented, and coachable - able to follow technical direction, apply code-review feedback, and produce accurate, well-tested, well-documented work.
• Strong written and verbal communication, comfortable raising questions and blockers clearly within a distributed agile delivery team.
Preferred Qualifications
• Suggested 1-2 years exposure to data migration or ETL modernization (e.g., Informatica-to-Databricks) and building pipelines within a team environment.
• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog (or Microsoft Purview), and Git-based CI/CD practices.
• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, or workforce, employee, organization, position, talent, and related HR data.
• Microsoft Azure or Databricks coursework/certification, and experience supporting U.S.-based enterprise clients from an offshore delivery model.
• Experience in insurance, financial services, HR technology, or another regulated, highly governed data environment.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
Key Responsibilities
• Develop and maintain assigned data pipelines using Azure Databricks, PySpark, Spark SQL, SQL, and Delta Lake, building Bronze/Silver/Gold objects to the program's medallion standards.
• Assist with converting legacy Informatica mappings, SQL, and stored procedures into Databricks processing, and support migration of inbound/outbound HR integrations (including Oracle HCM feeds).
• Implement source-to-target mappings and transformation specs, and help build logical/physical, dimensional, and analytics-ready models for HR data domains under senior direction.
• Perform data profiling, unit testing, and defect resolution; build data-quality and reconciliation checks and compare legacy vs. target-state outputs during parallel runs.
• Produce clear technical documentation - mappings, data dictionaries, test cases, runbooks, and deployment instructions - following established naming, repository, and version-control standards.
• Follow MetLife requirements for handling sensitive HR data, applying approved access-control, classification, and governance practices via Unity Catalog and related tooling.
• Participate in agile ceremonies, incorporate code-review feedback, escalate unclear requirements and risks to the Senior Data Engineer, and provide overlap with U.S. Eastern Time.
Required Qualifications
• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or related discipline (or equivalent practical experience), with 2+ years in data engineering, ETL, or data-platform delivery.
• Azure Databricks & Spark: 1+ year of practical exposure to Spark, PySpark, Databricks, or a comparable cloud environment, plus working experience with Python and SQL.
• Data fundamentals: Foundational understanding of ETL/ELT, Delta Lake, medallion architecture, data modeling (keys, relationships, normalization, dimensions), and source-to-target mappings.
• AI-assisted engineering: Willingness to use AI/Copilot tooling to accelerate development, testing, and documentation.
• Curious, detail-oriented, and coachable - able to follow technical direction, apply code-review feedback, and produce accurate, well-tested, well-documented work.
• Strong written and verbal communication, comfortable raising questions and blockers clearly within a distributed agile delivery team.
Preferred Qualifications
• Suggested 1-2 years exposure to data migration or ETL modernization (e.g., Informatica-to-Databricks) and building pipelines within a team environment.
• Azure ecosystem: Data Lake Storage, Data Factory, DevOps, Azure SQL/Synapse, Unity Catalog (or Microsoft Purview), and Git-based CI/CD practices.
• HR domain data: Oracle HCM Cloud extracts/PVOs/HDL, or workforce, employee, organization, position, talent, and related HR data.
• Microsoft Azure or Databricks coursework/certification, and experience supporting U.S.-based enterprise clients from an offshore delivery model.
• Experience in insurance, financial services, HR technology, or another regulated, highly governed data environment.
About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid
MetLife Mahārāshtra, IND Office
MetLife Pune, IN Office
EON West LP-II, 2nd & 3rd Floor, Tower D, S.no. 106(P), 107(P), 108(P)/1, Maharashtra, India, 411057
Similar Jobs at MetLife
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Build and deliver scalable, cloud-native, API-driven applications using React, Node.js, Next.js, Azure, REST APIs, and microservices. Develop accessible, high-performance interfaces, implement CI/CD pipelines, apply DevSecOps and automated testing practices, troubleshoot production issues, and collaborate with cross-functional teams to deliver reliable software solutions.
Top Skills:
AzureCi/CdDevsecopsGithub CopilotMicroservicesNext.JsNode.jsReactRest Apis
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and deploys scalable Azure Databricks data pipelines using PySpark, Spark SQL, and Delta Lake across medallion layers. Builds HR data models, source-to-target mappings, reconciliation controls, governance, lineage, documentation, and data quality processes. Modernizes legacy Informatica and SQL integrations, including Oracle HCM feeds. Collaborates with distributed agile teams, mentors junior engineers, and supports production cutovers for sensitive employee data.
Top Skills:
Ai/Copilot ToolingSparkAzure Data FactoryAzure Data Lake StorageAzure DevopsAzure SqlAzure SynapseCi/CdCrunchrDatabricksDelta LakeGitInformaticaOracle Hcm CloudPower BIPysparkSpark SqlSQLUnity Catalog
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Lead Oracle HCM Cloud implementations and provide hands-on configuration across Core HR, Performance Management, Learning, and Analytics. Translate business requirements into functional and technical designs, develop Fast Formulas, HCM Extracts, OTBI and BI Publisher reports, and support integrations using HDL, HSDL, REST, and SOAP. Perform testing, production support, troubleshooting, documentation, and stakeholder collaboration throughout the implementation lifecycle.
Top Skills:
Agent BuilderBi PublisherCore HrFast FormulasHcm AnalyticsHcm ExtractsHdlHsdlLearningOracle Hcm CloudOtbiPerformance ManagementRestSoapUnix Shell ScriptingVb
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
