Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop, test, and maintain Python- and SQL-based data pipelines and ETL/ELT processes on Google Cloud Platform. Build BigQuery transformations, support data warehouse modeling, troubleshoot data quality issues, document solutions, and collaborate with engineers and analysts. The role requires strong GCP data engineering experience, including BigQuery and Pub/Sub, with preferred experience in Cloud Composer, Dataflow, Cloud Functions, Git, and Google Cloud certification.
Top Skills:
Apache AirflowBigQueryCloud ComposerCloud FunctionsDataflowGitGoogle Cloud Platform (Gcp)Pub/SubPythonSQL
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Designs and builds secure, scalable data platforms and control-plane services across public cloud, on-premises, and sovereign environments. Architects lakehouse, distributed, batch, streaming, API, metadata, governance, and data-sharing solutions using modern cloud and open-source technologies. Establishes data-product, data-contract, security, reliability, and observability standards; develops production-quality software; optimizes infrastructure and costs; and mentors engineers while influencing technical direction across teams.
Top Skills:
Amazon EksApache IcebergApache PolarisSparkAws Glue Data CatalogAws IamAws S3Azure Data FactoryAzure Data Lake StorageAzure Key VaultAzure Kubernetes ServiceAzure RbacCi/CdDatabricksDelta LakeGitGrpcInfrastructure As CodeJavaKubernetesMicrosoft Entra IdParquetPysparkPythonRestSnowflakeTrinoUnity Catalog
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Administer and optimize Cloudera CDP/CDH environments and enterprise data-processing workloads. Develop PySpark and Python solutions, build CI/CD pipelines with Jenkins and Git repositories, integrate security and code-quality tools, optimize Hive and Impala SQL, monitor platform health, perform upgrades, troubleshoot issues, and implement security, access management, governance, and high-availability practices.
Top Skills:
BitbucketCdeCheckmarxCi/CdCloudera CdhCloudera CdpGitHadoopHdfsHiveHueImpalaJenkinsLinuxPysparkPythonSastSparkSQLYarn
Designs and maintains scalable batch and real-time data pipelines on Azure. Builds integrations with Azure Data Factory, Storage Accounts, and Event Hub; optimizes SQL, stored procedures, and database workloads; develops data models for analytics and warehousing; implements data quality, monitoring, CI/CD, and deployment automation; collaborates with stakeholders and architects; and mentors junior engineers.
We are seeking a highly skilled Data Engineer to design, develop, and optimize enterprise-scale data solutions on Azure. The ideal candidate will have strong expertise in ETL development, real-time data processing, Azure data services, advanced SQL, and data modeling.
This role will be responsible for building scalable, high-performance data pipelines, driving best practices, and supporting business-critical analytics and reporting initiatives.
Key Responsibilities
· Design, develop, and maintain scalable batch and real-time data pipelines.
· Architect and implement data integration solutions using Azure Data Factory, Azure Storage Accounts, and Azure Event Hub.
·Develop and optimize complex SQL queries, stored procedures, and database workloads to ensure performance and scalability.
· Build and support real-time/streaming data processing solutions leveraging Event Hub architecture.
· Design and implement robust data models to support analytics, reporting, and data warehousing requirements.
· Establish and maintain data quality, monitoring, performance tuning, and operational best practices.
Drive CI/CD implementation and automate deployment processes for data engineering solutions.
Drive CI/CD implementation and automate deployment processes for data engineering solutions.
· Collaborate with business stakeholders, architects, and development teams to deliver reliable and scalable data platforms.
· Mentor junior engineers and contribute to technical design reviews and solution architecture discussions.
Skills, Knowledge and Expertise
· 5+ years of experience in Data Engineering, ETL Development, or related roles.
· Strong hands-on experience in designing and developing ETL/ELT pipelines.
Proven experience with:
Proven experience with:
- Azure Data Factory (ADF)
- Azure Storage Accounts (Blob Storage/Data Lake Storage)
- Azure Event Hub
· Strong experience in real-time/streaming data processing using Event Hub architecture.
Advanced SQL expertise, including:
- Complex Joins
- CTEs & Window Functions
- Query Optimization
- Performance Tuning
- Stored Procedures & Database Design
· Solid understanding of data modeling concepts, including dimensional modeling, star schema, and enterprise data warehouse design.
· Experience with CI/CD practices, Git, and Azure DevOps.
· Strong troubleshooting, analytical, and problem-solving skills.
· Experience working in Agile delivery environments.
Preferred Skills
- Experience with Azure Databricks, Spark, or Python.
- Knowledge of Data Lake, Lakehouse, and modern cloud-based data architectures.
- Exposure to data governance, monitoring, and security best practices.
- Experience in designing scalable enterprise data platforms.
About
At ParentPay Group, we believe that when schools run well, students thrive. That’s why we’ve spent decades building the operating system that supports well‑run schools – a seamless layer of tools, insights, and support that makes school life simpler for teachers, leaders, caterers, parents, and students alike.From cashless payments and parent engagement to catering management, library systems, and MIS platforms, we connect the everyday parts of education through simple, secure, and connected tools. What began as a way to make school payments easier has grown into Europe’s leading EdTech group – trusted by over 20,000 schools and 9 million users across the UK and Europe.Every day, our platforms process millions of payments, messages, and data points, quietly working in the background so schools can shine out front. Together, we’re helping schools save time, cut costs, and create more time for learning.ParentPay Group is more than a collection of brands. We are a group of people dedicated to supporting well‑run schools and giving time back to teachers, parents, caterers, admin staff – and most importantly, to students.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
