Lead design and deliver end-to-end data solutions on Microsoft Fabric. Build and optimize PySpark/ELT pipelines, architect Lakehouse/Delta Lake with Medallion patterns, enforce data governance/lineage/security, implement CI/CD and DevOps, mentor engineers, troubleshoot production, and collaborate with stakeholders on performance and cost optimization.
About
The Company:
iLink Digital is a
Global Software Solution Provider and Systems
Integrator, delivers next-generation technology
solutions to help clients solve complex business
challenges, improve organizational effectiveness,
increase business productivity, realize sustainable
enterprise value and transform your business
inside-out. iLink integrates software systems and develops
custom applications, components, and frameworks on the latest
platforms for IT departments, commercial accounts, application
services providers (ASP) and independent software vendors
(ISV). iLink solutions are used in a broad range of industries
and functions, including healthcare, telecom, government, oil
and gas, education, and life sciences. iLink’s expertise
includes Cloud Computing & Application Modernization, Data
Management & Analytics, Enterprise Mobility, Portal,
collaboration & Social Employee Engagement, Embedded
Systems and User Experience design
etc.
What makes
iLink's offerings unique is the fact that we use
pre-created frameworks, designed to accelerate software
development and implementation of business processes for our
clients. iLink has over 60 frameworks (solution accelerators),
both industry-specific and horizontal, that can be easily
customized and enhanced to meet your current business
challenges.
Requirements
We are looking for a highly skilled Lead Data Engineer with strong expertise in Microsoft Fabric to design, develop, and manage modern data platforms. The ideal candidate will drive end-to-end data engineering solutions, mentor the team, and collaborate closely with business and technical stakeholders to deliver scalable and high-performance data pipelines.
- Lead the design and implementation of end-to-end data solutions on Microsoft Fabric, including Data Factory, Lakehouse, Warehouse, and Data Engineering experiences.
- Build and optimize ETL/ELT pipelines using PySpark, Dataflows Gen2, and Fabric pipelines.
- Architect and maintain Lakehouse and Delta Lake structures for large-scale data processing.
- Ensure strong data governance, quality, lineage, and security across the ecosystem.
- Work closely with data architects, analysts, and business partners to understand requirements and convert them into technical solutions.
- Oversee performance tuning, capacity planning, cost management, and platform optimization.
- Mentor junior data engineers and provide best practices for coding, design, and deployment.
- Implement CI/CD processes for Fabric workloads (Git integration, workspace management, DevOps).
- Troubleshoot data pipeline failures, production issues, and optimize workloads.
- Stay updated with Microsoft Fabric roadmap and bring innovative solutions into the architecture.
- 7+ years of experience in Data Engineering, with at least 2+ years in Microsoft Fabric or modern data platforms.
- Strong hands-on experience in:
- PySpark / Spark SQL
- Fabric Data Engineering, Lakehouse, Warehouse
- Pipelines, Dataflows Gen2, KQL, Notebooks
- Delta Lake and Medallion architecture
- PySpark / Spark SQL
- Solid understanding of data modeling, data warehousing, and SQL performance tuning.
- Experience with Azure services: ADLS, Synapse, Data Factory, Databricks (added advantage).
- Expertise in Git, DevOps practices, and production deployment workflows.
- Strong analytical/problem-solving skills and stakeholder management capabilities.
- Experience leading a team or owning end-to-end delivery of data solutions.
- Knowledge of Power BI integration with Fabric
- Experience with Real-time analytics / Event streaming
- Familiarity with Python development and API integrations
- Exposure to ML pipelines within Fabric
Benefits
- Competitive
salaries
- Medical
Insurance
- Employee
Referral Bonuses
- Performance
Based Bonuses
- Flexible
Work Options & Fun Culture
- Robust
Learning & Development Programs
- In-House
Technology Training
iLink Digital Pune, Mahārāshtra, IND Office
5th Floor, Malpani Agile, Pancard Club Road, Baner,, Pune, India, 411045
Similar Jobs
Fintech • Information Technology • Financial Services
Develop modular, efficient Python applications for portfolio analytics and client-facing solutions. Scope and deliver strategic technology projects, collaborate with stakeholders, and stay current with tools and finance platforms to improve business efficiency.
Top Skills:
AladdinAngularAzureBloombergDockerFactsetFlaskMorningstarMpiPythonReactRedisSnowflakeSQLStreamlitTypescript
37 Minutes Ago
Fintech • Information Technology • Financial Services
Senior VP role on US Leveraged Finance team performing fundamental credit research across capital structures, building financial models, generating trade ideas, interacting with management and sell-side, and communicating investment recommendations to portfolio managers and committees.
Top Skills:
ExcelFinancial Modeling
Fintech • Information Technology • Financial Services
The Quantitative Modeler will join the Portfolio Risk Modeling team to build and maintain risk models, ensuring model governance and collaborating with stakeholders on performance and analytics.
Top Skills:
PythonSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
