Lead design and deliver end-to-end data solutions on Microsoft Fabric. Build and optimize PySpark/ELT pipelines, architect Lakehouse/Delta Lake with Medallion patterns, enforce data governance/lineage/security, implement CI/CD and DevOps, mentor engineers, troubleshoot production, and collaborate with stakeholders on performance and cost optimization.
About
The Company:
iLink Digital is a
Global Software Solution Provider and Systems
Integrator, delivers next-generation technology
solutions to help clients solve complex business
challenges, improve organizational effectiveness,
increase business productivity, realize sustainable
enterprise value and transform your business
inside-out. iLink integrates software systems and develops
custom applications, components, and frameworks on the latest
platforms for IT departments, commercial accounts, application
services providers (ASP) and independent software vendors
(ISV). iLink solutions are used in a broad range of industries
and functions, including healthcare, telecom, government, oil
and gas, education, and life sciences. iLink’s expertise
includes Cloud Computing & Application Modernization, Data
Management & Analytics, Enterprise Mobility, Portal,
collaboration & Social Employee Engagement, Embedded
Systems and User Experience design
etc.
What makes
iLink's offerings unique is the fact that we use
pre-created frameworks, designed to accelerate software
development and implementation of business processes for our
clients. iLink has over 60 frameworks (solution accelerators),
both industry-specific and horizontal, that can be easily
customized and enhanced to meet your current business
challenges.
Requirements
We are looking for a highly skilled Lead Data Engineer with strong expertise in Microsoft Fabric to design, develop, and manage modern data platforms. The ideal candidate will drive end-to-end data engineering solutions, mentor the team, and collaborate closely with business and technical stakeholders to deliver scalable and high-performance data pipelines.
- Lead the design and implementation of end-to-end data solutions on Microsoft Fabric, including Data Factory, Lakehouse, Warehouse, and Data Engineering experiences.
- Build and optimize ETL/ELT pipelines using PySpark, Dataflows Gen2, and Fabric pipelines.
- Architect and maintain Lakehouse and Delta Lake structures for large-scale data processing.
- Ensure strong data governance, quality, lineage, and security across the ecosystem.
- Work closely with data architects, analysts, and business partners to understand requirements and convert them into technical solutions.
- Oversee performance tuning, capacity planning, cost management, and platform optimization.
- Mentor junior data engineers and provide best practices for coding, design, and deployment.
- Implement CI/CD processes for Fabric workloads (Git integration, workspace management, DevOps).
- Troubleshoot data pipeline failures, production issues, and optimize workloads.
- Stay updated with Microsoft Fabric roadmap and bring innovative solutions into the architecture.
- 7+ years of experience in Data Engineering, with at least 2+ years in Microsoft Fabric or modern data platforms.
- Strong hands-on experience in:
- PySpark / Spark SQL
- Fabric Data Engineering, Lakehouse, Warehouse
- Pipelines, Dataflows Gen2, KQL, Notebooks
- Delta Lake and Medallion architecture
- PySpark / Spark SQL
- Solid understanding of data modeling, data warehousing, and SQL performance tuning.
- Experience with Azure services: ADLS, Synapse, Data Factory, Databricks (added advantage).
- Expertise in Git, DevOps practices, and production deployment workflows.
- Strong analytical/problem-solving skills and stakeholder management capabilities.
- Experience leading a team or owning end-to-end delivery of data solutions.
- Knowledge of Power BI integration with Fabric
- Experience with Real-time analytics / Event streaming
- Familiarity with Python development and API integrations
- Exposure to ML pipelines within Fabric
Benefits
- Competitive
salaries
- Medical
Insurance
- Employee
Referral Bonuses
- Performance
Based Bonuses
- Flexible
Work Options & Fun Culture
- Robust
Learning & Development Programs
- In-House
Technology Training
iLink Digital Pune, Mahārāshtra, IND Office
5th Floor, Malpani Agile, Pancard Club Road, Baner,, Pune, India, 411045
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead business analysis for Risk Weighted Assets (RWA) and Counterparty Credit Risk (CCR) initiatives. Translate Basel III/IV and SA-CCR/IMM/EAD regulatory requirements into BRDs, FRDs, user stories, process flows and data mappings. Liaise with Market Risk, CCR, Regulatory Reporting, Finance, Quant and Technology teams to support capital calculations, RWA optimization and regulatory reporting for transformation programs.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior Test Automation Engineer will develop, test, and maintain payment applications, focusing on test automation and high-quality software delivery. Responsibilities include designing test cases, building automation frameworks, executing automated tests, and contributing to continuous improvement initiatives.
Top Skills:
BddBrunoCucumberDockerFortifyGitlabInsomniaIntellijJava 17Java 8JenkinsJmeterJSONJunitKarateMavenNexusiqOctaneOracleRallyRest ApiSonarqubeSQLSwaggerTestngXML
7 Hours Ago
Financial Services
Manage end-to-end broking operations for equity and currency derivatives (F&O), including trade contracting, confirmations, clearing, settlement, reconciliations, reporting, and exception management. Monitor margins and positions, coordinate with clients, exchanges, custodians and banks, investigate breaks, prepare operational and regulatory reports, respond to queries, and drive root-cause fixes and process improvements to enhance straight-through processing.
Top Skills:
AlteryxBseExcelMicrosoft WordNseTableauUipath
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
