Design, develop, and maintain data pipelines and platforms using Microsoft Fabric and Azure, ensuring data quality and supporting analytics.
Note: Only CV which are as per JD will be contacted.
Job Title: Data Engineer / Senior Data Engineer
Location : UAE - Onsite
Role Purpose
Job Title: Data Engineer / Senior Data Engineer
Location : UAE - Onsite
Role Purpose
Design, develop, and maintain scalable data pipelines and modern data platforms using Microsoft Fabric and Azure ecosystem. The role involves building efficient data solutions that support analytics, reporting, and advanced data use cases across the organization.
Key Responsibilities- Design, build, and maintain robust ETL/ELT pipelines using Azure Data Factory (ADF) and Microsoft Fabric
- Develop and optimize data workflows using PySpark and SQL
- Implement and manage Lakehouse architecture using Medallion (Bronze, Silver, Gold) layers
- Work with Azure Data Lake Storage (ADLS) and Delta Lake for efficient data storage and processing
- Integrate data from multiple sources ensuring data quality, consistency, and reliability
- Collaborate with BI developers and analysts to enable data models and reporting solutions
- Monitor, troubleshoot, and optimize data pipelines and performance issues
- Ensure data governance, security, and compliance best practices
- Lead the design and architecture of scalable data platforms and solutions
- Define data engineering standards, best practices, and frameworks
- Mentor junior data engineers and review code for quality and performance
- Optimize large-scale data processing and improve system efficiency
- Collaborate with stakeholders to translate business requirements into technical solutions
- Drive adoption of Microsoft Fabric and modern data engineering practices across teams
- Hands-on experience with Azure Data Factory (ADF) and ADLS
- Strong programming skills in PySpark and SQL
- Experience in building ETL pipelines and working with structured/unstructured data
- Basic understanding of Lakehouse and Medallion architecture
- Familiarity with Delta Lake concepts
- Good problem-solving and debugging skills
- Extensive experience in Azure data ecosystem and Microsoft Fabric
- Strong expertise in designing end-to-end data architectures
- Deep understanding of Lakehouse, Medallion architecture, and Delta Lake
- Proven experience in handling large-scale distributed data processing
- Strong performance tuning and optimization skills
- Experience leading projects and mentoring teams
- Experience in Azure Databricks
- Knowledge of data modeling and data warehousing concepts
- Exposure to data governance and data quality frameworks
- Experience working in Agile environments
- Strong communication and stakeholder management skills
- Analytical thinking and problem-solving mindset
- Ability to work independently and in a collaborative team environment
Top Skills
Azure Data Factory
Azure Data Lake Storage
Delta Lake
Lakehouse
Medallion Architecture
Microsoft Fabric
Pyspark
SQL
Similar Jobs
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Senior Software Engineer - Data Engineer will lead project phases, design technical solutions, manage team efforts, and collaborate globally while driving innovative data solutions.
Top Skills:
AWSAzureEtl TechnologiesGCPSnowflakeSQL
Information Technology • Consulting
The Senior Data Engineer role involves designing and operating cloud-native data solutions and building reliable pipelines for analytics and AI, requiring extensive knowledge in data engineering and collaboration with various teams.
Top Skills:
AuroraAWSAzureDatabricksJavaPostgresPythonSparkSQL
Fintech • Payments • Financial Services
Design and own the architecture for FNZ's Aggregated Analytical Warehouse, focusing on privacy, cross-client analytics, and data governance. Responsibilities include defining data models, architecting privacy solutions, and overseeing technical evaluations of confidential compute vendors.
Top Skills:
Apache FlinkAzureConfidential ComputingDifferential PrivacyFederated LearningMicrosoft Fabric
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
