The Senior Azure Data Engineer is responsible for designing, implementing, and maintaining data solutions on the Azure platform, developing data pipelines, optimizing data storage, ensuring data quality, and collaborating with data scientists while monitoring the processes.
ProArch is looking for a highly skilled and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions using the Azure data platform.
Responsibilities:
- Design, develop, and implement data engineering solutions on the Azure platform
- Create and maintain data pipelines and ETL processes
- Optimize data storage and retrieval for performance and scalability
- Collaborate with data scientists and analysts to build data models and enable data-driven insights
- Ensure data quality and integrity through data validation and cleansing
- Monitor and troubleshoot data pipelines and resolve any issues
- Stay up-to-date with the latest Azure data engineering best practices and technologies
- Excellent communication skills
- Strong in Python
- The ability to understand businesses concepts and work with customers to process data accurately.
- A solid of understanding Azure Data Lake, Spark for Synapse (or Azure Databricks), Synapse Pipelines (or Azure Data Factory), Mapping Data Flows, SQL Server, Synapse Serverless/Pools (or SQL Data Warehouse).
- Experience with source control, version control and moving data artifacts from Dev to Test to Prod.
- A proactive self-starter, who likes deliver value, solves challenges and make progress.
- Comfortable working in a team or as an individual contributor
- Good data modelling skills (e.g., relationships, entities, facts, and dimensions)
- The ability to source and ingest data in multiple formats of various variety, volume, veracity and velocity
Top Skills
Python
Similar Jobs
Artificial Intelligence • Consulting
As a Senior Azure Data Engineer, you will develop and maintain large-scale technical solutions to solve complex business problems for Fortune 500 clients. Your responsibilities include software development throughout the SDLC phases, integrating systems, and building the knowledge base for technology projects.
Top Skills:
PysparkPython
AdTech • Marketing Tech
The Senior Azure Data Engineer will lead a team managing custom database solutions and developing ELT pipelines. Responsibilities include data architecture oversight, performance monitoring, CI/CD management, and technical support for production data jobs. The role also involves collaborating with business stakeholders, mentoring junior engineers, and ensuring adherence to agile methodologies.
Top Skills:
AzureSQL
Information Technology
The Azure Data Engineer will manage data engineering projects, develop and maintain data pipelines, ensure data quality and security, and collaborate with teams to address data requirements. Responsibilities include optimizing data processes and staying updated with emerging data technologies.
Top Skills:
Data Engineering
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
