Designs and maintains scalable Python data pipelines, ETL/ELT processes, backend data services, and cloud-based data solutions. Ensures data quality, performance, reliability, governance, and cost efficiency across high-volume distributed systems. Collaborates with multiple teams, makes technical decisions, serves as a subject matter expert, mentors junior engineers, and continuously improves data engineering practices.
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Python Frameworks
Good to have skills : Ab Initio
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Project Role Description
As a Python Data Engineer, you will be responsible for designing, developing, and maintaining highly scalable data pipelines, backend data services, and cloud-based data solutions. Your typical day will involve working with cross-functional teams to ingest, process, and transform large volumes of data across multiple systems, ensuring high performance, reliability, and data quality.
You will leverage Python and multi-cloud technologies to build robust and efficient data workflows, with a strong focus on scalability, optimization, and low-latency processing. A cloud-first and agile mindset, combined with continuous improvement, will be key to delivering enterprise-grade data solutions.
Roles & Responsibilities:
Expected to be an SME.
Collaborate and manage the team to perform.
Responsible for team decisions.
Engage with multiple teams and contribute to key decisions.
Provide solutions to problems for their immediate team and across multiple teams.
Design and develop highly scalable data pipelines and ETL/ELT processes for large-scale data processing.
Build and maintain data services/APIs for seamless data consumption across systems.
Ensure data quality, validation, and consistency across pipelines.
Optimize data workflows for scalability, performance, and cost efficiency.
Handle high-volume and high-velocity datasets with efficient processing strategies.
Mentor junior team members to foster their professional growth and development.
Continuously evaluate and improve data engineering processes to enhance team productivity.
Professional & Technical Skills:
Must To Have Skills: Proficiency in Python (Programming Language).
Strong experience in building scalable data pipelines and distributed data processing systems.
Solid understanding of databases (SQL and NoSQL) and advanced query optimization techniques.
Experience with ETL/ELT frameworks and data integration patterns.
Hands-on experience with multi-cloud platforms (AWS, Azure, or Google Cloud) and cloud-native data services.
Experience with workflow orchestration tools (e.g., Apache Airflow or equivalent).
Familiarity with CI/CD tools (Git, Jenkins) and containerization (Docker).
Strong understanding of performance tuning, scalability, and distributed system design principles.
Understanding of data quality, data lineage, and governance frameworks.
Good To Have Skills: Exposure to programming languages such as Java or Scala in distributed environments.
Additional Information:
The candidate should have a minimum of 10 years of experience in Python (Programming Language).
A 15 years full-time education is required.15 years full time education
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Python Frameworks
Good to have skills : Ab Initio
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education
Project Role Description
As a Python Data Engineer, you will be responsible for designing, developing, and maintaining highly scalable data pipelines, backend data services, and cloud-based data solutions. Your typical day will involve working with cross-functional teams to ingest, process, and transform large volumes of data across multiple systems, ensuring high performance, reliability, and data quality.
You will leverage Python and multi-cloud technologies to build robust and efficient data workflows, with a strong focus on scalability, optimization, and low-latency processing. A cloud-first and agile mindset, combined with continuous improvement, will be key to delivering enterprise-grade data solutions.
Roles & Responsibilities:
Expected to be an SME.
Collaborate and manage the team to perform.
Responsible for team decisions.
Engage with multiple teams and contribute to key decisions.
Provide solutions to problems for their immediate team and across multiple teams.
Design and develop highly scalable data pipelines and ETL/ELT processes for large-scale data processing.
Build and maintain data services/APIs for seamless data consumption across systems.
Ensure data quality, validation, and consistency across pipelines.
Optimize data workflows for scalability, performance, and cost efficiency.
Handle high-volume and high-velocity datasets with efficient processing strategies.
Mentor junior team members to foster their professional growth and development.
Continuously evaluate and improve data engineering processes to enhance team productivity.
Professional & Technical Skills:
Must To Have Skills: Proficiency in Python (Programming Language).
Strong experience in building scalable data pipelines and distributed data processing systems.
Solid understanding of databases (SQL and NoSQL) and advanced query optimization techniques.
Experience with ETL/ELT frameworks and data integration patterns.
Hands-on experience with multi-cloud platforms (AWS, Azure, or Google Cloud) and cloud-native data services.
Experience with workflow orchestration tools (e.g., Apache Airflow or equivalent).
Familiarity with CI/CD tools (Git, Jenkins) and containerization (Docker).
Strong understanding of performance tuning, scalability, and distributed system design principles.
Understanding of data quality, data lineage, and governance frameworks.
Good To Have Skills: Exposure to programming languages such as Java or Scala in distributed environments.
Additional Information:
The candidate should have a minimum of 10 years of experience in Python (Programming Language).
A 15 years full-time education is required.15 years full time education
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.Visit us at www.accenture.com
Equal Employment Opportunity Statement
We believe that no one should be discriminated against because of their differences. All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law. Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.
Accenture Mahārāshtra, IND Office
India
Accenture Pune, Mahārāshtra, IND Office
Building B-1, Magarpatta City (SEZ, Mundhwa Rd, Magarpatta, Hadapsar, Pune, Maharashtra, India, 411013
Similar Jobs
Information Technology
Designs, develops, and maintains enterprise data solutions, pipelines, data foundations, and ETL/ELT processes. Ensures data quality, integrates and migrates data across cloud systems, and supports data modeling and processing. The role partners with technical and business stakeholders, leads data strategy implementation, coordinates change and incident management, presents findings, mentors junior engineers, and drives scalable, cost-effective delivery.
Top Skills:
Amazon KinesisAmazon RedshiftApache AirflowAWSAws GlueAzure Data FactoryAzure DatabricksAzure DevopsAzure Stream AnalyticsAzure SynapseData IngestionData IntegrationData ModelingData ProcessingEltGitGithub ActionsAzureSAPSQLSql Database
Information Technology
Design, develop, and maintain data solutions, pipelines, and ETL processes for generating, collecting, processing, migrating, and deploying data. Ensure data quality, governance, security, and compliance while using cloud platforms, Databricks, vector databases, and GenAI/RAG technologies. Collaborate across teams, make technical decisions, provide solutions, and mentor junior data engineers. The role requires expertise in data modeling, database design, SQL, NoSQL, Python, and cloud data services.
Top Skills:
AWSAzureAzure Data ServicesAzure DevopsContainerizationCrewaiDatabricksETLGCPNoSQLPythonRagSQLVector Databases
Information Technology
Designs, develops, and maintains data foundations, pipelines, ETL/ELT processes, and data integration solutions. Ensures data quality, supports migration across systems, and translates data strategy into scalable technology solutions. Collaborates with technical and business stakeholders, presents findings, leads implementation initiatives, manages change and incidents, and mentors junior engineers. Required expertise includes Azure, Databricks, data modeling, cloud data platforms, orchestration, streaming, and SQL technologies.
Top Skills:
Amazon KinesisAmazon RedshiftApache AirflowAWSAws GlueAzure Data FactoryAzure DatabricksAzure DevopsAzure Stream AnalyticsAzure SynapseData IngestionData IntegrationData ManipulationData ModelingData ProcessingEltGithub ActionsAzureSAPSQLSql Database
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
