Organisation:
At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Senior Data Engineer
Location: Bengaluru
Business & Team:
We are looking for innovative ML OPS Engineer to join our ADDS team within Business Bank. In this role, you will integrate AI models into business processes, focusing on building APIs, scaling model scoring functions, and managing scalable data access patterns for both batch and real-time AI use cases—covering both traditional and generative AI. You will leverage cloud platforms, containerization, and CICD practices to ensure secure, scalable, and efficient AI solutions.
This role is ideal for engineers with experience in building large scale applications using Python, R, Spark ETL, Teradata, AWS tools (Sage maker, EMR, Redshift), Snowflake and who thrive on solving complex business problems using advanced AI tools.
Roles & Responsibilities:
- Model Scoring & Scaling: Develop scalable model scoring functions that handle high-volume, low-latency AI requests, ensuring models perform effectively across batch and real-time use cases.
- Scalable Data Access Patterns: Design and implement robust data access patterns for both batch and real-time AI processes, enabling optimal performance for traditional machine learning and generative AI models.
- Cloud Integration: Deploy AI models on cloud platforms, ensuring they are scalable, secure, and cost-efficient, supporting both batch and real-time workloads.
- CICD Pipeline Implementation: Build and maintain CICD pipelines for the continuous integration, testing, and deployment of AI models and APIs, ensuring a streamlined and automated development process.
- Problem Solving & Optimization: Collaborate with cross-functional teams to solve complex business challenges through the integration of scalable AI solutions, improving business outcomes.
- Collaboration & Coordination: Work with data scientists, engineers, and business stakeholders to ensure AI models are successfully integrated and aligned with business goals.
- Security & Compliance: Ensure that all AI models and solutions meet internal security requirements and comply with industry regulations, particularly in the banking sector.
Essential Skills:
- 8 to 10 years of Experience.
- Proficiency in Python, R, Spark ETL, Teradata, AWS tools (Sage maker, EMR, Redshift), Snowflake, with experience maintaining scalable ML models.
- Hands-on experience with cloud platforms (AWS, GCP, Azure) for AI deployment and integration, supporting both batch and real-time data processing.
- Expertise in scalable data access patterns for both batch and real-time AI models.
- Experience designing, building, and maintaining in Data Engineering solutions
- Experience setting up CICD pipelines for automating the deployment and testing of AI models.
- Strong problem-solving skills, with a focus on creating scalable solutions that deliver business impact.
Preferred Qualification:
- Experience in the banking or financial services industry, particularly with AI integration projects.
- Familiarity with data pipeline and processing tools like Apache Kafka, Spark, or similar.
- Utilize containerization technologies such as Docker and Kubernetes for scalable, secure model deployment and orchestration in cloud environments.
- Knowledge of AI governance, risk management, and compliance frameworks in regulated environments.
Education Qualifications:
- B.E. or B. Tech. or equivalent or post-graduation degree in Computer Applications or IT or Business Administration with 10+ years of relevant experience.
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
