ScatterPie Analytics Private Limited Logo

ScatterPie Analytics Private Limited

Manager – Data Engineering

Posted Yesterday
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level
Lead end-to-end data engineering projects across Azure and AWS, including requirements gathering, technical roadmaps, scalable data pipelines, ETL, data integration, sprint planning, resource allocation, risk management, and delivery tracking. Manage client relationships, stakeholder communication, demos, and retrospectives while ensuring timelines, quality, and budget adherence. Collaborate with data engineers and BI developers and recommend emerging data engineering tools and practices.
The summary above was generated by AI
Role Summary:

    We are looking for an experienced and hands-on Project Manager in Data Engineering who can lead the end-to-end delivery of data pipeline projects across Azure and AWS environments. The ideal candidate will bring strong technical depth in data engineering along with client-facing and project execution capabilities.

Key Responsibilities

· Lead and manage multiple data engineering projects across Azure and AWS ecosystems.

· Gather client requirements and translate them into technical specifications and delivery roadmaps.

· Design, oversee, and ensure successful implementation of scalable data pipelines, ETL processes, and data integration workflows.

· Collaborate with internal data engineers, BI developers, and client stakeholders to ensure smooth project execution.

· Ensure adherence to timelines, quality standards, and cost constraints.

· Identify project risks, dependencies, and proactively resolve issues.

· Own the client relationship from initiation to delivery – conduct regular check-ins, demos, and retrospectives.

· Stay updated on emerging tools and best practices in the data engineering space and recommend their adoption.

· Lead sprint planning, resource allocation, and tracking using Agile or hybrid methodologies.



Requirements

· 7–10 years of total experience in data engineering and project delivery.

· Strong experience in Azure Data Services – Azure Data Factory, Synapse, Databricks, Data Lake, etc.

· Working knowledge of AWS data tools such as Glue, Redshift, S3, and Lambda functions.

· Good understanding of data modeling, data warehousing, and pipeline orchestration.

· Experience with tools such as Talend, Airflow, DBT, or other orchestration platforms is a plus.

· Proven track record of managing enterprise data projects from requirement gathering to deployment.

· Client-facing experience with strong communication and stakeholder management skills.

· Strong understanding of project management methodologies and tools (e.g., JIRA, Trello, MS Project).



Similar Jobs

19 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Lead design and delivery of scalable data pipelines and platforms, manage and mentor a data engineering team, partner with business and analytics to translate requirements, enforce data quality, governance and security, and ensure operational stability and performance for analytics and AI use cases.
Top Skills: Data WarehousingDatabricksEltETLLakehousePythonSQL
3 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • Big Data • Enterprise Web • Fintech • Software • Financial Services
Lead and grow an ML engineering team to design, build, and operate a unified AI/ML data collection platform. Own data ingestion, feature management, LLM/RAG workflows, model lifecycle, evaluation, observability, scalability, governance, and cross-functional alignment while mentoring engineers and driving platform reliability and operational excellence.
Top Skills: AirflowAWSAzureDagsterDockerEmbeddingsGCPKafkaKubernetesLlmsMlflowMlopsPythonRagSnowflakeSQLVector DatabasesWeights & Biases (W&B)
13 Days Ago
In-Office or Remote
India
Expert/Leader
Expert/Leader
eCommerce • Healthtech • Software
Lead data engineering initiatives to build ingestion, integration, and common data models; enable data products and governance across domains; design scalable cloud-based data architectures and ML pipelines; collaborate with business and tech teams to deliver data products, ensure data quality, and drive adoption.
Top Skills: APIsAWSAzureData CatalogingData FabricData MeshDatabricksDbtExcelGCPMdmPower BIPysparkPythonSnowflakeSQLStreamingSynapseTableau

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account