The Senior Data Engineer will support strategic data initiatives, focusing on Silver/Gold layer development, replatforming, and collaboration on documentation. Responsibilities include data quality checks, model updates, and supporting business metrics definitions.
We are seeking a Senior Data Engineer to support our strategic data initiatives. As we implement a Medallion Architecture (Bronze/Silver/Gold layers) and replatform several core transactional systems, this role will be critical in ensuring data quality, governance, and scalability. You will focus on operationalizing Silver and Gold data layers, adapting pipelines to new data sources, and ensuring downstream analytics, dashboards, and reporting remain reliable during this transition.
Key Responsibilities:
Silver/Gold Layer Development
- Translate raw data from sources (Zuora, CommerceTools, APIs, legacy databases) into curated Silver and Gold tables.
- Apply business logic, standardization, and data quality checks.
- Partner with analysts and business stakeholders to validate metric definitions.
Replatforming Support
- Audit existing pipelines for dependencies on legacy data structures.
- Update models and jobs to consume data from new transactional systems.
- Ensure lineage tracking and compatibility with downstream reporting and analytics.
Collaboration & Documentation
- Work closely with engineers, analysts, and business partners to document requirements, transformations, and validations.
- Contribute to metadata tagging and data cataloging (Unity Catalog).
- Deliver detailed documentation including data dictionaries, constraints (PK, FK), and pipeline logic.
- Minimum 7+ years of relevant experience
- Strong data modeling skills (Kimball methodology) with hands-on Databricks experience.
- Proficiency in SQL and Python
- Expertise with Databricks features such as workflows, DLTs, Delta tables, and Unity Catalog.
- Familiarity with Medallion Architecture (Bronze/Silver/Gold layers).
- Experience with version control systems (GitHub).
- Solid understanding of data governance, data quality frameworks, and observability practices.
- Ability to work effectively across analytics, product, and engineering teams.
Preferred skills:
- Experience with replatforming large transactional systems.
- Exposure to subscription and commerce data domains
Top Skills
Databricks
Git
Medallion Architecture
Python
SQL
Unity Catalog
Similar Jobs
Blockchain • Gaming • Software • Virtual Reality • Metaverse
Lead the evolution of decentralized data infrastructure, design and maintain ETL/ELT pipelines, and collaborate across teams to derive insights from data.
Top Skills:
AirflowAWSDbtMeltanoMetabasePythonSegmentSnowflake
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead the development of data platform solutions, ensuring effective data management and performance. Foster innovation and mentor engineering teams while solving complex data challenges.
Top Skills:
JavaJavaScriptKubernetes
Cloud • Security • Software • Analytics
As a Senior Data Engineer, you'll design data applications, manage SQL databases, develop data pipelines using Python, and collaborate with teams on data integration and reporting.
Top Skills:
APIsBigQueryC#ETLExcelJavaJSONMicrosoft FabricPower BIPythonSisenseSQL ServerT-Sql
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
