Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Senior Data Engineer
Location: Bangalore-Manyata Tech Park
Business & Team:
Technology Team is responsible for the world leading application of technology and operations across every aspect of CommBank, from innovative product platforms for our customers to essential tools within our business. We also use technology to drive efficient and timely processing, an essential component of great customer service.The team is also accountable to facilitate a community of practitioners to share best practice and build data talent and capabilities.
Impact & Contribution:
As a Data Engineer and database engineer you will be creating and managing the cloud databases and data pipelines on cloud architecture. You have proven expertise in database design, data ingestion, transformation, data writing, scheduling and query management within a cloud environment.
You will have proven experience and expertise in working with AWS Cloud Infrastructure Engineers, design, develop, deploy and operate data services and solutions in cloud ecosystem. You will take ownership and accountability of functional and non-functional design and work within a team of Engineers to create innovative solutions that unlock value and modernise technology designs.
You will role model continuous improvement mindset in the team, and in your project interactions, by taking technical ownership of key assets, including roadmaps and technical direction of data services running on our AWS environments.
Roles & Responsibilities:
- Reporting to a Data Engineering Manager
- Utilizing Big Data technologies to solve our customers' hardest data centric problems.
- Working closely with the Solution Designers and Business Analysts to perform Data Ingestion, Enrichment and Egression
- Working across the Group Data Warehouse, Big Data Platform,AWS and Ab Initio.
- Designing and building group data products by integrating diverse data from hundreds of internal and external sources
- Adopting tools, programming languages and templates to improve our data quality and efficiency
- Building and optimizing Big Data pipelines, architecture, and data sets
- End to end ownership and accountability of the business requirements, design, and code reviews, identify technical / performance issues and solve them.
- Learn and adapt to new technologies to solve problems and improve existing solutions.
- Should have good hands-on experience on the AWS Services like EC2, S3, RDS, Lambda, API Gateway, DynamoDB, CloudFront, Route 53 etc.
- Should have hands-on experience on database like RDS, DynamoDB, Redshift, Aurora etc.
- Should have experience on CI/CD pipelines, Jenkins, CodePipeline, CodeBuild, CodeCommit etc
- Should have exposure on any of the streaming technologies like Kafka, AWS Kinesis, AWS Kinesis Data Firehose etc.
- Required to maintain and build excellent relationships with CDAO peers and stakeholders as well as actively contribute to business outcomes and team culture.
- Mentoring and providing support to junior Data Engineers within the team
- Prior experience on Banking Domain / Financial Services related projects would be a great value add.
- Good to have experience in Python.
- Exposure to JIRA/ Confluence would be beneficial.
- Hands on experience of Tableau, d3 and Shiny for presentation of data insights is a great value add
Essential Skills:
- Minimum 7+ years of experience
- AWS Data products such as AWS Glue and AWS EMR
- AWS S3 ingestion, transformation and writing to databases
- Proficiency in programming languages like Python, Scala or Java for developing data ingestion and transformation scripts.
- Strong knowledge of SQL for writing, optimizing, and debugging queries.
- Familiarity with database design, indexing, and normalization principles.
Understanding of data formats (JSON, CSV, XML) and techniques for converting between them. Ability to handle data validation, cleaning, and transformation. - Proficiency in automation tools and scripting (e.g., bash scripting, cron jobs) for scheduling and monitoring data processes.
- Experience with version control systems (e.g., Git) for managing code and collaboration.
- AWS certification preferred
- Nice to have AI exposure
Education Qualification: Bachelor’s degree or Master’s degree in Engineering in Computer Science/Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
