The Middle Data Engineer will lead data migration from RDS to Google BigQuery, design data management systems, and maintain data pipelines effectively.
Company Description
Our Client is developing a high-volume Data Lake on Google BigQuery and expanding their data engineering team. We are seeking a Middle Data Engineer to contribute to data migration and pipeline development using modern GCP technology.
Job DescriptionIn this role, you will help build and maintain data pipelines, implement CDC processes, and support the migration from RDS to BigQuery. You’ll work independently while receiving direction from senior engineers and the Engineering Manager.
Working hours: 14:00–23:00
Responsibilities
- Lead the migration of data from RDS to Google BigQuery.
- Design, construct, test, and maintain highly scalable data management systems.
- Ensure systems meet business requirements and industry practices.
- Integrate new data management technologies and software engineering tools into existing structures.
- Work with messaging systems and data pipelines.
- Employ a variety of technologies and tools to marry systems together.
- Drive the improvements on data reliability, efficiency, and quality.
- 5+ years of hands-on experience with Google Cloud Platform, including: BigQuery, DataStream (CDC), Dataflow, Pub/Sub
- Strong Java development background.
- Experience with Spring Boot.
- Proven expertise in building CDC pipelines and distributed data processing systems.
- Track record of migrating large datasets from relational databases into BigQuery.
- Strong knowledge of automated testing (unit, integration, pipeline tests).
- Ability to work autonomously, make architectural decisions, and own end-to-end delivery.
Top Skills
BigQuery
Dataflow
Datastream
Google Cloud Platform
Java
Pub/Sub
Spring Boot
Similar Jobs
Big Data • Cloud • Food • Machine Learning • Software • Database • Analytics
This role involves building and validating predictive models using data analytics to inform pricing decisions, optimize promotions, and enhance revenue growth. Responsibilities include conducting market analysis, collaborating across teams, and maintaining automated reports while supporting strategic projects.
Top Skills:
ExcelPower BIPowerPointPythonRSQLTableau
Big Data • Cloud • Food • Machine Learning • Software • Database • Analytics
Lead Kraft Heinz's Global Capability Centre, managing P&L, operational efficiencies, team development, and stakeholder partnerships.
Top Skills:
AnalyticsAutomationGenai
Big Data • Cloud • Food • Machine Learning • Software • Database • Analytics
Lead the HR function for Kraft Heinz's Global Capability Centre, overseeing various HR verticals, strategies, and initiatives to drive organizational growth and employee engagement.
Top Skills:
Compensation & BenefitsHr ManagementPeople PracticesTalent AcquisitionTalent Management
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
