Design, develop, and maintain scalable ETL/ELT pipelines and data models using Azure Databricks and SQL. Optimize data processing workflows, ensure data quality, support cloud data warehouse initiatives, troubleshoot pipeline performance, and collaborate with stakeholders to deliver analytics-ready data for BI and reporting.
This role is for one of the Weekday's clients
Salary range: Rs 1500000 - Rs 2700000 (ie INR 15-27 LPA)
Experience: 5+ yrs
Location: Pune, Maharashtra, India
Job Type: Full-Time
We are looking for a skilled Data Engineer with expertise in Azure Databricks, ETL, and SQL to design, develop, and optimize scalable data solutions that support enterprise analytics and business intelligence initiatives. The ideal candidate will have experience building robust data pipelines, transforming large datasets, and enabling reliable, high-performance data platforms within modern cloud environments.
In this role, you will collaborate with cross-functional teams including data architects, analysts, business stakeholders, and engineering teams to deliver efficient data integration solutions, ensure data quality, and support data-driven decision-making across the organization.
RequirementsKey Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for ingesting, transforming, and loading data from multiple sources.
- Build and optimize data processing workflows using Azure Databricks, SQL, and cloud-native technologies.
- Develop reliable data models and transformation logic to support reporting, analytics, and business intelligence requirements.
- Write, optimize, and maintain complex SQL queries, stored procedures, and data transformation scripts.
- Monitor, troubleshoot, and optimize data pipelines for performance, scalability, and reliability.
- Ensure data quality through validation, reconciliation, and automated quality checks.
- Collaborate with business users, analysts, and technical teams to translate data requirements into scalable technical solutions.
- Support cloud-based data warehouse initiatives and data integration projects.
- Implement best practices for data governance, security, documentation, and compliance.
- Participate in performance tuning, process automation, and continuous improvement initiatives across the data platform.
- Strong hands-on experience with Azure Databricks, ETL development, and SQL.
- Proven experience building and supporting enterprise-scale data engineering solutions.
- Excellent SQL skills with expertise in query optimization and data transformation.
- Solid understanding of cloud-based data platforms, data warehousing concepts, and modern data architectures.
- Experience designing scalable and efficient data pipelines for structured and semi-structured data.
- Knowledge of data modeling, performance optimization, and data quality management practices.
- Strong analytical and problem-solving skills with attention to detail.
- Experience working in collaborative Agile development environments.
- Excellent communication and stakeholder management skills with the ability to work across technical and business teams.
- A proactive mindset with a passion for building reliable, scalable, and high-performing data platforms that drive business insights.
Similar Jobs
Artificial Intelligence • Consulting
Design, build, and maintain Azure-based data infrastructure and pipelines. Implement data models and schemas, ensure data quality, optimize distributed storage and processing (Databricks/PySpark), and establish engineering best practices while partnering with cross-functional teams.
Top Skills:
AdfAdls2Ai FactoryAzureDatabricksDevOpsPygenticPysparkPythonUltimate
.png)
Other
Design, build, and maintain scalable people-data pipelines, warehouses, and datasets using structured and unstructured sources. Improve pipeline efficiency and data quality, ensure regulatory compliance, research data warehouse tools, create dashboards for leadership, and collaborate cross-functionally to enable data-driven people analytics.
Top Skills:
AIAzure Data FactoryAzure Sql Data WarehouseBig-DataEtl ToolsGitMachine LearningPythonSQL
Information Technology • Database • Consulting
Design, build, and maintain Azure-based data pipelines and data models using Synapse, Spark, SQL and ADLS. Implement ETL/ELT, ensure data quality, optimize performance, support deployment/monitoring, and collaborate with analysts, scientists, and stakeholders.
Top Skills:
Azure Data FactoryAzure Data Lake Storage (Adls)Azure DevopsAzure Synapse AnalyticsCi/CdDelta LakeEtl/EltAzurePythonSparkSQLVersion Control
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
