Design, implement, and maintain data pipelines, ensure data quality, collaborate with stakeholders, and support PowerBI reporting development.
Job Title: Sr Data Engineer
Skills:
- Advanced proficiency in Azure Data Factory and related Azure services for designing ETL workflows.
- Strong understanding of data warehouse design, specifically in the context of Azure Synapse Analytics.
- Proficient in Python for automating data processing tasks and integrating with APIs as needed.
- Familiarity with PowerBI for building and maintaining reports and dashboards.
- Understanding of cloud architecture and capabilities, particularly in a Microsoft Azure environment.
Responsibilities:
- Design, implement, and maintain data pipelines, ensuring data accuracy and consistency.
- Collaborate with stakeholders in both reporting and analytics to gather requirements and provide insights.
- Monitor and troubleshoot data pipelines and ETL processes to ensure data quality and operational efficiency.
- Play an active role in ensuring the smooth transition from SSAS Cubes to the Data Warehouse, ensuring minimal downtime and maintaining current SLAs.
- Support PowerBI reporting development, with a focus on efficiency and best practices.
Top Skills
Azure Data Factory
Azure Synapse Analytics
Power BI
Python
Similar Jobs
Artificial Intelligence • Big Data • Machine Learning
The Senior Data Engineer will design optimized search and analytics solutions with Elasticsearch and SQL, manage data pipelines, troubleshoot issues, and develop APIs, ensuring smooth operations with various teams.
Top Skills:
AirflowAWSAzureDockerElasticsearchGCPGitKafkaKinesisKubernetesNifiPythonSQL
Artificial Intelligence • Big Data • Machine Learning
Design and implement data solutions using Snowflake, create ETL pipelines, optimize performance, and manage Databricks environments. Requires strong skills in SQL, Spark, and cloud integrations.
Top Skills:
AdfSparkAws GlueAws S3Azure Data LakeDatabricksGoogle Cloud StorageGoogle DataflowPysparkPythonScalaSnowflakeSQL
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Collaborate with teams to gather technical requirements, design, and implement solutions, write production-ready code, and ensure high-quality deliverables in a cloud environment.
Top Skills:
AWSAzureCi/CdCloud ComputingDevOpsETLGCPJavaPythonRdbmsScalaSpark
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
