Designs, builds, and operates scalable data platforms and Lakehouse pipelines on Azure Databricks. Responsibilities include ELT and streaming, Delta Lake optimization, Unity Catalog governance, CI/CD, data integration, platform performance, and troubleshooting. The role collaborates with Integration and Data Architects, coordinates cross-functional initiatives, supports enterprise data strategies, mentors engineers, and delivers reliable datasets for BI, machine learning, and generative AI use cases.
Project Role : Data Platform Engineer
Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Data Platform Engineer, a typical day involves contributing to the development and refinement of the data platform blueprint and design, ensuring that all relevant components are effectively incorporated. This role requires close collaboration with Integration Architects and Data Architects to maintain seamless integration between various systems and data models. The position demands active engagement in aligning platform strategies with organizational goals, facilitating smooth data flow and interoperability across multiple teams and technologies. The engineer plays a key role in supporting the overall architecture and ensuring that the platform meets evolving business and technical requirements.
Roles & Responsibilities:
- Expected to be an SME, collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Lead efforts to optimize data platform performance and scalability.
- Mentor junior team members to enhance their technical capabilities and understanding.
- Coordinate cross-functional initiatives to align data platform development with enterprise objectives.
-Build and operate scalable Lakehouse pipelines on Databricks/Azure. Own ELT/streaming, Delta Lake optimization, Unity Catalog governance, and CI/CD. Integrate ADLS/ADF/Synapse, and deliver high-quality data sets for BI/ML/GenAI.
-Must-haves: PySpark, SQL, Databricks (Delta, DLT/Workflows), Azure data services, Unity Catalog, CI/CD.
MLflow/Feature Store, Power BI, streaming/CDC, vector search/RAG, Terraform.
Professional & Technical Skills:
- Must To Have Skills: Proficiency in Microsoft Azure Databricks.
- Experience with distributed computing frameworks and big data processing.
- Strong knowledge of cloud-based data storage and management solutions.
- Familiarity with data integration techniques and ETL processes.
- Ability to troubleshoot and resolve complex data platform issues.
- Understanding of data security and governance principles within cloud environments.
Additional Information:
- The candidate should have minimum 5 years of experience in Microsoft Azure Databricks.
- This position is based at our Pune office.
- A 15 years full time education is required.
15 years full time education
Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:
As a Data Platform Engineer, a typical day involves contributing to the development and refinement of the data platform blueprint and design, ensuring that all relevant components are effectively incorporated. This role requires close collaboration with Integration Architects and Data Architects to maintain seamless integration between various systems and data models. The position demands active engagement in aligning platform strategies with organizational goals, facilitating smooth data flow and interoperability across multiple teams and technologies. The engineer plays a key role in supporting the overall architecture and ensuring that the platform meets evolving business and technical requirements.
Roles & Responsibilities:
- Expected to be an SME, collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Lead efforts to optimize data platform performance and scalability.
- Mentor junior team members to enhance their technical capabilities and understanding.
- Coordinate cross-functional initiatives to align data platform development with enterprise objectives.
-Build and operate scalable Lakehouse pipelines on Databricks/Azure. Own ELT/streaming, Delta Lake optimization, Unity Catalog governance, and CI/CD. Integrate ADLS/ADF/Synapse, and deliver high-quality data sets for BI/ML/GenAI.
-Must-haves: PySpark, SQL, Databricks (Delta, DLT/Workflows), Azure data services, Unity Catalog, CI/CD.
MLflow/Feature Store, Power BI, streaming/CDC, vector search/RAG, Terraform.
Professional & Technical Skills:
- Must To Have Skills: Proficiency in Microsoft Azure Databricks.
- Experience with distributed computing frameworks and big data processing.
- Strong knowledge of cloud-based data storage and management solutions.
- Familiarity with data integration techniques and ETL processes.
- Ability to troubleshoot and resolve complex data platform issues.
- Understanding of data security and governance principles within cloud environments.
Additional Information:
- The candidate should have minimum 5 years of experience in Microsoft Azure Databricks.
- This position is based at our Pune office.
- A 15 years full time education is required.
15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Accenture Mahārāshtra, IND Office
India
Accenture Pune, Mahārāshtra, IND Office
Building B-1, Magarpatta City (SEZ, Mundhwa Rd, Magarpatta, Hadapsar, Pune, Maharashtra, India, 411013
Similar Jobs
Artificial Intelligence • Information Technology • Machine Learning • Consulting
Design, build, and operate ETL/ELT data pipelines, data models, REST APIs, and production AI/LLM applications. Develop AI skills, agent workflows, and MCP server integrations for internal systems and business use cases. Collaborate with product, data, and engineering teams while owning reliability, quality, documentation, and deployment. The role requires independent execution, strong communication, and experience with Python, SQL, data engineering, AI application development, and platform capabilities.
Top Skills:
Ai ApplicationsCloud Data PlatformsEtl/EltJavaScriptLlmsMcp ServersOrchestration ToolsPythonRest ApisSQLTypescript
Fintech • Financial Services
Lead and hands-on build Citi's low-latency, high-concurrency data platform: design and implement streaming pipelines (Flink), microservices, Redis caching, Kafka-based distribution, cloud-native deployments, mentor engineers, ensure performance/resilience, and drive CI/CD and operational excellence.
Top Skills:
AngularApache FlinkApache KafkaDruidEcsFlink Datastream ApiFlink SqlGitIgniteJava (11+)JenkinsKubernetesLarge Language ModelsOpenshiftPinotPythonReactRedisRedis ClusterSonarqubeTeamcityTrino
Information Technology
Designs and refines data platform blueprints, collaborates with Integration and Data Architects, implements data integration and modeling solutions, ensures data quality for large datasets, mentors junior staff, and proposes improvements and risk mitigations for a cohesive data platform.
Top Skills:
Advanced Data VisualizationData AnalyticsPower BI
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
