Billigence Logo

Billigence

Senior Data Engineer(ADF&Databricks)

Posted 22 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Design, build, and optimize scalable ELT/ETL pipelines on Azure using ADF and Databricks, integrate data into Snowflake, implement Data Vault 2.0 modelling, ensure data quality and performance, and collaborate with stakeholders and analytics teams to maintain production workflows.
The summary above was generated by AI

About Billigence:

Billigence is a boutique data consultancy with global outreach & clientele, transforming the way organizations work with data. We leverage proven, cutting-edge technologies to design, tailor, and implement advanced Business Intelligence solutions with high added value across a wide range of applications from process digitization through to Cloud Data Warehousing, Visualisation, Data Science, and Engineering or Data Governance. Headquartered in Sydney, Australia with offices around the world, we help clients navigate difficult business conditions, remove inefficiencies, and enable scalable adoption of analytics culture.

About the role :

We are looking for an experienced Azure Data Factory & Databricks Developer with strong hands-on expertise in Azure data engineering, Snowflake, and modern data modeling techniques. The ideal candidate will have decent years of project experience and will be responsible for designing, developing, and optimizing scalable ELT/ETL solutions on the Microsoft Azure platform.

What you'll do: 

  • Design, develop, and maintain Azure Data Factory (ADF) pipelines for reliable data ingestion and orchestration
  • Develop and optimize Databricks notebooks for large-scale data processing and transformations
  • Implement robust ELT/ETL processes integrating multiple data sources into Snowflake
  • Perform data modeling using modern approaches, including Data Vault 2.0
  • Write, optimize, and maintain complex SQL statements and SQL scripts
  • Ensure data quality, performance optimization, and scalability across data pipelines
  • Collaborate with stakeholders, data architects, and downstream analytics teams to deliver high-quality data solutions
  • Troubleshoot, monitor, and improve existing data workflows in production environment

What you'll need :

  • Decent years of project experience in data engineering or data platform development
  • Strong hands-on experience with Azure Data Factory (ADF)
  • Proven experience developing solutions using Azure Databricks
  • Solid experience working with Snowflake as a cloud data warehouse
  • Expertise in SQL, including performance tuning and complex query writing
  • Strong understanding of ELT/ETL architectures and best practices
  • Experience with Data Modelling, specifically Data Vault 2.0
  • Familiarity with cloud-based data infrastructure on Microsoft Azure



Benefits:

  • Hybrid/remote working environment, allowing you a flexible work-life balance to thrive both in the office and from the comfort of your home.
  • Competitive compensations package + performance bonus.
  • Referral bonus scheme.
  • Coaching, mentoring, and buddy scheme (for faster integration during the probationary period)
  • Certification opportunities throughout your time with us.
  • Career growth support, internal moves, and career advancement opportunities.
  • Team building and networking events.

Top Skills

Azure Data Factory (Adf),Azure Databricks,Snowflake,Sql,Data Vault 2.0,Microsoft Azure

Similar Jobs

37 Minutes Ago
Remote
Gujarat, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The Facilities Project Engineer oversees design, execution, and commissioning of HVAC and Process Utility systems in various industries, ensuring compliance with standards and timely project delivery.
Top Skills: Hvac SystemsMs Project)Process Utility SystemsProject Planning Tools (Primavera
37 Minutes Ago
Remote
Gujarat, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The Electrical Project Engineer oversees project execution for Electrical systems in semiconductor facilities, ensuring safety, budget adherence, and effective communication among teams. Responsibilities include scope management, procurement support, installation assurance, risk tracking, and leading project closeout activities.
Top Skills: Electrical EngineeringHigh Voltage Electrical DistributionProject ManagementSemiconductor Systems
37 Minutes Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
The Mechanical Utility Technician will oversee the installation, maintenance, and repair of utility equipment, ensuring compliance with safety and operational standards. Responsibilities include maintaining operational records, managing inventory, and coordinating contractor work.
Top Skills: Acid-ScrubbersCompressorsCooling-TowersDryersEtp SystemsExhaust SystemsFire-PumpsHeat ExchangersPumpsSprinklers SystemsStpWtp

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account