The Principal Data Engineer leads a data team, focuses on resource management, and ensures compliance with data practices while fostering career growth and solving data issues.
Job Title: Principal Data Engineer, Logistics
Employment Type: Full Time
Experience: 12+ Years
About the Role:
We are looking for a Principal Data Engineer to lead the design and delivery of scalable data solutions using Azure Data Factory and Azure Databricks. This is a consulting-focused role that requires strong technical expertise, stakeholder engagement, and architectural thinking.
You will work closely with business, functional, and technical teams to define data strategies, design robust pipelines, and ensure smooth delivery in an Agile environment.
Responsibilities
- Collaborate with business and technology stakeholders to gather and understand data needs
- Translate functional requirements into scalable and maintainable data architecture
- Design and implement robust data pipelines
- Lead data modeling, transformation, and performance optimization efforts
- Ensure data quality, validation, and consistency
- Participate in Agile ceremonies including sprint planning and backlog grooming
- Support CI/CD automation for data pipelines and integration workflows
- Mentor junior engineers and promote best practices in data engineering
Must Have
- 12+ years of IT experience, with at least 5 years in data architecture roles in modern metadata driven and cloud-based technologies, bringing a software engineering mindset
- Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production issues
- Excellent communication skills, with experience in leading client-facing discussion
- Strong hands-on experience with Azure Data Factory and Databricks, leveraging custom solutioning and design beyond drag-and-drop capabilities for big data workloads
- Demonstrated proficiency in SQL, Python, and Spark
- Experience with CI/CD pipelines, version control and DevOps tools
- Experience with applying dimensional and Data Vault methodologies
- Background in working with Agile methodologies and sprint-based delivery
- Ability to produce clear and comprehensive technical documentation
Nice to Have
- Experience with Azure Synapse and Power BI
- Experience with Microsoft Purview and/or Unity Catalog
- Understanding of Data Lakehouse and Data Mesh concepts
- Familiarity with enterprise data governance and quality frameworks
- Manufacturing experience within the operations domain
Top Skills
Azure
Azure Data Factory
Azure Devops
Power BI
Python
Servicenow
SQL
Ssis
Synapse
Similar Jobs
Cloud • Software
The Solutions Engineer will interface with enterprise sales, present ThousandEyes technology, support solution trials, and drive market awareness and growth.
Top Skills:
BgpDnsHTTPJavaScriptPerlPythonSaaSTcp/Ip
Cloud • Information Technology • Security • Software
The Human Resources Coordinator provides administrative support in employee lifecycle management, recruiting, onboarding, and HR operations, while maintaining accurate records.
Top Skills:
Google SuiteMicrosoft Platforms
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
The Senior Software Engineer will build and innovate within the BlackLine application and data platform focusing on SAP ERP, particularly in modules FI and CO, mentoring team members, and delivering scalable software solutions while ensuring high coding standards.
Top Skills:
CdsEcc6.0EclipseFioriOdataPostmanS/4HanaSap AbapTest Driven Design
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
