The Azure Data Engineer will build data pipelines and dataflows, implement security modules, and work with Azure services while supporting business requirements and data analysis.
This is a remote position.
Roles & Responsibilities:
- Understand business requirement and actively provide inputs from Data perspective.
- Understand the underlying data and flow of data.
- Build simple to complex pipelines & dataflows.
- Work with other Azure stack modules like Azure Data Lakes, SQL DW, etc.
- Should be able to implement modules that has security and authorization frameworks.
- Recognize and adapt to the changes in processes as the project evolves in size and function.
Requirements
Knowledge, Skills & Abilities:
- Expert level knowledge on Azure Data Factory.
- Expert level knowledge of SQL DB & Data warehouse (e.g. Microsoft SQL Server 2012/2016 & SSIS)
- Should know at least one programming language (e.g. C#, Visual Basic .NET, C++ .NET, PowerShell)
- Should be able to analyse and understand complex data.
- Knowledge of Azure data lake is an added advantage.
- Knowledge of other Azure Services like Analysis Service, SQL Databases will be an added advantage
- Excellent interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision
Similar Jobs
Artificial Intelligence • Big Data • Information Technology • Consulting
The Azure Data Engineer will implement big data pipelines using Azure technologies, collaborate with stakeholders, and utilize tools like Data Factory and Databricks.
Top Skills:
Azure Data FactoryAzure Data LakesDatabricksGitPower BIPythonSQLSynapse
Fintech • Financial Services
The Data Engineer will design, develop, and maintain data pipelines and solutions, ensuring data quality and collaborating with cross-functional teams to meet analytics needs.
Top Skills:
Apache AirflowSparkAWSAzureDockerDynamoDBGCPGitHadoopJavaJenkinsKafkaKubernetesLuigiMongoDBMySQLNode.jsPostgresPythonTerraform
Fintech • Financial Services
Lead the design and development of scalable data pipelines using Ab-initio and Python, migrating workflows, ensuring data quality, and mentoring team members.
Top Skills:
Ab-InitioAWSAzureDeltaDockerGCPGitPandasParquetPysparkPythonSparkSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
