Design, build, and maintain Azure-based data pipelines and data models using Synapse, Spark, SQL and ADLS. Implement ETL/ELT, ensure data quality, optimize performance, support deployment/monitoring, and collaborate with analysts, scientists, and stakeholders.
Key Responsibilities
- Design, build, and maintain data pipelines using Azure services
- Develop and optimize solutions using Azure Synapse Analytics (pipelines, Spark, SQL pools)
- Implement ETL/ELT processes for ingesting and transforming data from multiple sources
- Design and manage data models to support reporting and analytics
- Work with structured and unstructured datasets in a data lake environment
- Ensure data quality, integrity, and consistency across pipelines
- Optimize performance of queries, pipelines, and storage
- Collaborate with data analysts, data scientists, and business stakeholders
- Support deployment, testing, and monitoring of data solutions
- Maintain documentation for data processes and architectures
Required Skills & Experience
- Strong hands-on experience with Microsoft Azure data services
- Proven experience with Azure Synapse Analytics (pipelines, Spark, SQL)
- Proficiency in SQL and Python
- Experience with data warehousing concepts and dimensional modeling
- Experience with ETL/ELT design and implementation
- Familiarity with Azure Data Lake Storage (ADLS)
- Understanding of distributed data processing (e.g., Spark)
- Experience with version control and CI/CD practices (Azure DevOps preferred)
Soft Skills
- Strong analytical and problem-solving abilities
- Good communication and stakeholder interaction skills
- Ability to work independently and within a team
- Attention to detail and focus on quality
Preferred Qualifications
- 6+ years of experience in Data Engineering.
- Experience with Delta Lake or similar technologies
- Exposure to Azure Data Factory
- Knowledge of performance tuning and query optimization
- Understanding of data governance and security best practices in Azure
EXL Pune, Mahārāshtra, IND Office
Pune, India
Similar Jobs
Artificial Intelligence • HR Tech • Professional Services • Software
Design, develop, and maintain scalable ETL/ELT pipelines and data models using Azure Databricks and SQL. Optimize data processing workflows, ensure data quality, support cloud data warehouse initiatives, troubleshoot pipeline performance, and collaborate with stakeholders to deliver analytics-ready data for BI and reporting.
Top Skills:
AzureAzure DatabricksData WarehousingETLSQL
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
.png)
Other
Design, build, and maintain scalable people-data pipelines, warehouses, and datasets using structured and unstructured sources. Improve pipeline efficiency and data quality, ensure regulatory compliance, research data warehouse tools, create dashboards for leadership, and collaborate cross-functionally to enable data-driven people analytics.
Top Skills:
AIAzure Data FactoryAzure Sql Data WarehouseBig-DataEtl ToolsGitMachine LearningPythonSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
