Commonwealth Bank Logo

Commonwealth Bank

Senior Data Engineer

Posted 3 Days Ago
Be an Early Applicant
In-Office
Park Road, Andheri, Mumbai Suburban, Maharashtra
Senior level
In-Office
Park Road, Andheri, Mumbai Suburban, Maharashtra
Senior level
The Senior Data Engineer will build solutions utilizing Big Data technologies, manage data pipelines, and collaborate with teams while ensuring data quality and performance optimization.
The summary above was generated by AI

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things

Job Title:  Senior Data Engineer

Location: Bangalore-Manyata Tech Park (Hybrid)

Business & Team: Financial Crime Technology – Enterprise Data Platform

 Impact & contribution:

You will work with Product Owner /lead engineer in the squad working towards impact of Enterprise Transformation Program across key applications.

Roles & Responsibilities:

  • In your role as a Data Engineer, you will be reporting to a Data Engineering Manager
  • Utilizing Big Data technologies to solve our customer data centric problems.
  • Working closely with the Senior Data engineer, Solution Designers and Business Analysts to understand and perform Data Ingestion, Enrichment and Egression
  • Working across the Group Data Warehouse (GDW), Big Data Platform (Omnia) & AWS Cloud Platform
  • Building group data products by integrating diverse data from hundreds of internal and external sources
  • Adopting tools, programming languages and templates to improve our data quality and efficiency
  • Building and optimizing Big Data pipelines, architecture and data sets
  • End to end ownership and accountability of the business requirements, identify technical / performance issues and solve them.
  • Learn and adapt to new technologies to solve problems and improve existing solutions
  • Required to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team culture

Essential Skills:

  • Minimum of 7+ years of hands-on experience in Software Engineering or development to build solution in Hadoop, Hive and Spark technologies.
  • Strong hands-on experience in any of the language (Scala/Python) with spark ETL development.
  • Good experience in any of them (Teradata / Oracle / SQL Server / MySQL) with strong SQL expertise
  • Good hands-on experience in any of the CI/CD tools like IntelliJ, TeamCity & Github cloud action.
  • The code maintenance repository like Github & bit bucket
  • Minimum of 7+ years of experience on Shell Scripting
  • Hands on experience in any cloud platform like AWS
  • Good to have hands-on experience in any ETL Tool like Ab initio GDE/BRE
  • Good Understanding of Distributed system and computing
  • Good to have hands on experience on Performance Tuning
  • Should be aware of AGILE processes and methodologies
  • A natural ability to effectively communicate, educate and influence the different stakeholders/ peers, to solve challenging problems, while working in collaboration with other cross-functional engineering and solution design teams
  • A positive desire to contribute towards initiatives, along with a strong ‘can- do’ attitude in juggling between constantly changing priorities
  • Flexible to cross trained to organisational adopted tools & technologies

Education Qualifications:

  • A degree in Engineering / Computer Science or a related discipline

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 24/07/2025

Top Skills

AWS
Ci/Cd Tools
Etl Tool
Git
Hadoop
Hive
Intellij
MySQL
Oracle
Python
Scala
Shell Scripting
Spark
SQL Server
Teamcity
Teradata

Similar Jobs

3 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Senior Data Engineer will lead data management projects, deliver robust data solutions, mentor junior engineers, and implement best practices in a collaborative environment.
Top Skills: AnalyticsBig DataData ManagementETL
11 Days Ago
Hybrid
Mumbai, Maharashtra, IND
Senior level
Senior level
Financial Services
Lead an agile team focusing on AI/ML solutions using AWS. Responsibilities include developing code, mentoring, and driving technological innovations.
Top Skills: AWSEc2Enterprise JavaLambdaPythonPyTorchSagemakerTensorFlow
6 Days Ago
In-Office
Pune, Maharashtra, IND
Senior level
Senior level
Biotech
As a Senior Data Engineer, you will develop and maintain data pipelines, ensure data quality, collaborate with teams, and lead data initiatives.
Top Skills: Apache AirflowAWSBigQueryGlueHiveLambdaPythonRedshiftS3SesSnowflakeSnsSparkSQLSqsTrino

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account