The Lead Data Engineer will develop Azure-based data engineering solutions, implement ETL processes, collaborate with stakeholders, and drive innovation in data strategy.
The BI Data Engineer is a key role within the Enterprise Data team. We are looking for expert Azure data engineer with deep Data engineering, ADF Integration and database development experience. This is a unique opportunity to be involved in delivering leading-edge business analytics using the latest and greatest cutting-edge BI tools, such as cloud-based databases, self-service analytics and leading visualisation tools enabling the company’s aim to become a fully digital organisation.
Job Description:
Key Responsibilities:
- Build Enterprise data engineering and Integration solutions using the latest Azure platform, Azure Data Factory, Azure SQL Database, Azure Synapse and Azure Fabric
- Development of enterprise ETL and integration routines using ADF
- Evaluate emerging Data enginnering technologies, standards and capabilities
- Partner with business stakeholder, product managers, and data scientists to understand business objectives and translate them into technical solutions.
- Work with DevOps, engineering, and operations teams to implement CI/CD pipelines and ensure smooth deployment of data engiinering solutions
Required Skills and Experience
Technical Expertise:
- Expertise in the Azure platform including Azure Data Factory, Azure SQL Database, Azure Synapse and Azure Fabric
- Exposure to Data bricks and lakehouse arcchitect & technologies
- Extensive knowledge of data modeling, ETL processes and data warehouse design principles.
- Experienc in machine learning and AI services in Azure.
Professional Experience:
- 5+ years of experience in database development using SQL
- 5+ Years integration and data engineering experience
- 5+ years experience using Azure SQL DB, ADF and Azure Synapse
- 2+ Years experience using Power BI
- Comprehensive understanding of data modelling
- Relevant certifications in data engineering, machine learning, AI.
Key Competencies:
- Expertise in data engineering and database development.
- Familiarity with the Microsoft Fabric technologies including One Lake, Lakehouse and Data Factory
- Strong understanding of data governance, compliance, and security frameworks.
- Proven ability to drive innovation in data strategy and cloud solutions.
- A deep understanding of business intelligence workflows and the ability to align technical solutions
- Strong database design skills, including an understanding of both normalised form and dimensional form databases.
- In-depth knowledge and experience of data-warehousing strategies and techniques e.g., Kimball Data warehousing
- Experience in Cloud based data integration tools like Azure Data Factory
- Experience in Azure Dev Ops or JIRA is a plus
- Experience working with finance data is highly desirable
- Familiarity with agile development techniques and objectives
Location:
PuneBrand:
DentsuTime Type:
Full timeContract Type:
PermanentTop Skills
Azure Data Factory
Azure Fabric
Azure Sql Database
Azure Synapse
Data Bricks
Power BI
Similar Jobs
AdTech • Marketing Tech • Software
The Lead Data Engineer will develop and integrate solutions on Azure, implement ETL processes, and collaborate with stakeholders to meet business objectives.
Top Skills:
AIAzureAzure Data FactoryAzure FabricAzure Sql DatabaseAzure SynapseData BricksMachine LearningPower BI
Consulting
As a Lead Data Engineer, you'll support business objectives by building data models, collaborating across teams, and automating data processes to improve operations.
Top Skills:
AthenaAWSCloud FormationEvent BridgeGlueLake FormationLambdaMySQLPythonRRdsRedshiftS3ScalaSQLSQL ServerStep Functions
Fintech • Financial Services
Lead development and implementation of application systems and programs, manage projects, analyze complex business processes, and provide guidance to developers. Ensure compliance and enhance application integration.
Top Skills:
Amazon S3Aws-EcsBig DataBit BucketCloudwatchCode BuildCode PipelineElasticFixHadoopHiveImpalaJIRAJSONKafkaMongoDBOraclePythonSpark SqlTibcoXML
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
