Design, build, and maintain Microsoft Fabric Lakehouses and scalable ETL/ELT pipelines. Develop PySpark/Spark SQL transformations, Delta tables, and Medallion Architecture layers. Implement CDC, data modeling, and quality frameworks. Integrate multiple sources, support Power BI semantic models, optimize performance, and enable analytics and AI/ML datasets.
Lakehouse Development
- Design and maintain Fabric Lakehouse environments.
- Develop and optimize Delta Tables for high-performance analytics workloads.
- Implement Medallion Architecture (Bronze, Silver, Gold layers) to support data quality and governance requirements.
- Create curated datasets for reporting, analytics, and AI/ML use cases.
Data Transformation & Processing
- Develop data transformation logic using PySpark, Spark SQL, and notebooks.
- Create reusable frameworks and data engineering best practices.
- Perform data cleansing, enrichment, and standardization activities.
- Data Modeling & Analytics Support
- Design dimensional and analytical data models.
- Collaborate with Business Intelligence teams to support Power BI semantic models and reporting requirements.
- Ensure data consistency, quality, and accuracy across data platforms.
Key Responsibilities
Data Engineering & Integration
- Design, develop, and maintain scalable data ingestion and transformation pipelines using Microsoft Fabric.
- Build and manage ETL/ELT workflows using Fabric Data Factory and Data Pipelines.
- Integrate data from multiple sources including databases, APIs, flat files, cloud storage, and SaaS applications.
- Implement incremental data loads and Change Data Capture (CDC) strategies.
Graduate in Computer Science, Data Science, or related field. 4-6 years of experience in data engineering or related field.
Required Skills
Technical Skills
- Microsoft Fabric
- OneLake
- Fabric Lakehouse
- Fabric Data Factory
- Data Pipelines
- Notebook Development
- PySpark
- Spark SQL
- SQL
- Delta Lake
- Medallion Architecture
- Power BI Integration
- Git Version Control
Cloud & Data Platform Experience
- Azure Data Services
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics (preferred)
- Azure DevOps
Data Engineering Concepts
- ETL/ELT Development
- Data Modeling
- Data Warehousing
- Data Governance
- Data Quality Frameworks
- Performance Tuning
Preferred Qualifications
- Experience in large-scale enterprise data transformation programs.
- Knowledge of Data Mesh and Modern Data Platform concepts.
- Exposure to AI/ML data preparation processes.
- Microsoft Fabric Certification (Preferred).
Experience working in Banking, Insurance, Healthcare, or Retail domains.
EXL Pune, Mahārāshtra, IND Office
Pune, India
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Serve as the ledger Subject Matter Expert driving GL and sub-ledger integration, accounting treatments, ledger process mapping, reconciliations, controls and period-end close. Translate finance requirements into functional specifications, partner with technology on target ledger architecture, support audits and governance, mentor finance team members, and approve functional readiness for releases.
Healthtech • Information Technology • Software • Telehealth
Lead a team of 8-10 to manage provider data operations: oversee daily workflows, ensure quality and SLAs, coach staff, drive process improvements, partner cross-functionally, and pilot AI/automation to scale and improve data quality.
Top Skills:
Ai-Driven ToolsConfluenceExcelGoogle DocsGoogle SheetsMonday.ComPowerPointSalesforceWord
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead and mentor engineering teams to design, build, test, and deliver scalable .NET and React-based cloud-native solutions on Azure. Drive architecture, refactoring, automation, DevOps practices, roadmap prioritization, and cross-functional product management while applying AI/ML and Databricks where appropriate.
Top Skills:
.Net.Net CoreAi/MlAngularAzureC#DatabricksDevOpsEntity Framework CoreGitGit ActionsJavaNoSQLPythonReactRest ApiSonarSQLWeb Api
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
