Design, build, and maintain Azure-based data pipelines and data models using Synapse, Spark, SQL and ADLS. Implement ETL/ELT, ensure data quality, optimize performance, support deployment/monitoring, and collaborate with analysts, scientists, and stakeholders.
Key Responsibilities
- Design, build, and maintain data pipelines using Azure services
- Develop and optimize solutions using Azure Synapse Analytics (pipelines, Spark, SQL pools)
- Implement ETL/ELT processes for ingesting and transforming data from multiple sources
- Design and manage data models to support reporting and analytics
- Work with structured and unstructured datasets in a data lake environment
- Ensure data quality, integrity, and consistency across pipelines
- Optimize performance of queries, pipelines, and storage
- Collaborate with data analysts, data scientists, and business stakeholders
- Support deployment, testing, and monitoring of data solutions
- Maintain documentation for data processes and architectures
Required Skills & Experience
- Strong hands-on experience with Microsoft Azure data services
- Proven experience with Azure Synapse Analytics (pipelines, Spark, SQL)
- Proficiency in SQL and Python
- Experience with data warehousing concepts and dimensional modeling
- Experience with ETL/ELT design and implementation
- Familiarity with Azure Data Lake Storage (ADLS)
- Understanding of distributed data processing (e.g., Spark)
- Experience with version control and CI/CD practices (Azure DevOps preferred)
Soft Skills
- Strong analytical and problem-solving abilities
- Good communication and stakeholder interaction skills
- Ability to work independently and within a team
- Attention to detail and focus on quality
Preferred Qualifications
- 6+ years of experience in Data Engineering.
- Experience with Delta Lake or similar technologies
- Exposure to Azure Data Factory
- Knowledge of performance tuning and query optimization
- Understanding of data governance and security best practices in Azure
EXL Pune, Mahārāshtra, IND Office
Pune, India
Similar Jobs
Information Technology • Database • Consulting
Design, build, and maintain ETL/ELT pipelines into Snowflake using Azure Data Factory and DBT. Write optimized SQL, integrate diverse data sources, monitor and optimize pipeline performance, enforce data quality and governance, and collaborate with analysts, architects, and DevOps in a cloud-native environment.
Top Skills:
AzureAzure Data FactoryDbtSnowflakeSnowsqlSQL
Artificial Intelligence • Consulting
Design, develop, and maintain cloud data infrastructure, data pipelines, data models, and storage solutions on Azure. Ensure data quality, integrate with cross-functional teams, optimize distributed systems, and establish data engineering best practices.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
