The Data Engineer will develop and deliver engineering solutions, focusing on ETL processes for compliance tech. Responsibilities include data analysis, workflow design, coding, unit testing, and working in an agile environment. The role also involves collaboration with stakeholders and ensuring reliability in data sourcing and ingestion workflows.
Job Description:
Job Title: Data Engineer (ETL, Big Data, Hadoop, Spark, GCP)
Location: Pune, India
Corporate Title: Assistant Vice President
Role Description
- Senior engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals.
- Awareness is expected of the important engineering principles of the bank. Root cause analysis skills develop through addressing enhancements and fixes 2 products build reliability and resiliency into solutions through early testing peer reviews and automating the delivery life cycle.
- Successful candidate should be able to work independently on medium to large sized projects with strict deadlines.
- Successful candidates should be able to work in a cross application mixed technical environment and must demonstrate solid hands-on development track record while working on an agile methodology. The role demands working alongside a geographically dispersed team.
- The position is required as a part of the buildout of Compliance tech internal development team in India.
- The overall team will primarily deliver improvements in Com in compliance tech capabilities that are major components of the regular regulatory portfolio addressing various regulatory common commitments to mandate monitors.
What we’ll offer you
As part of our flexible scheme, here are just some of the benefits that you’ll enjoy
- Best in class leave policy
- Gender neutral parental leaves
- 100% reimbursement under childcare assistance benefit (gender neutral)
- Sponsorship for Industry relevant certifications and education
- Employee Assistance Program for you and your family members
- Comprehensive Hospitalization Insurance for you and your dependents
- Accident and Term life Insurance
- Complementary Health screening for 35 yrs. and above
Your key responsibilities
- Analyzing data sets and designing and coding stable and scalable data ingestion workflows also integrating into existing workflows
- Working with team members and stakeholders to clarify requirements and provide the appropriate ETL solution.
- Work as a senior developer for developing analytics algorithm on top of ingested data.
- Work as though senior developer for various data sourcing in Hadoop also GCP.
- Own unit testing UAT deployment end user sign off and prod go live.
- Ensuring new code is tested both at unit level and system level design develop and peer review new code and functionality.
- Operate as a team member of an agile scrum team.
- Root cause analysis skills to identify bugs and issues for failures.
- Support Prod support and release management teams in their tasks.
Your skills and experience:
- More than 10 years of coding experience in experience and reputed organizations
- Hands on experience in Bitbucket and CI/CD pipelines
- Proficient in Hadoop, Python, Spark ,SQL Unix and Hive
- Basic understanding of on Prem and GCP data security
- Hands on development experience on large ETL/ big data systems .GCP being a big plus
- Hands on experience on cloud build, artifact registry ,cloud DNS ,cloud load balancing etc.
- Hands on experience on Data flow, Cloud composer, Cloud storage ,Data proc etc.
- Basic understanding of data quality dimensions like Consistency, Completeness, Accuracy, Lineage etc.
- Hands on business and systems knowledge gained in a regulatory delivery environment.
- Banking experience regulatory and cross product knowledge.
- Passionate about test driven development.
- Prior experience with release management tasks and responsibilities.
- Data visualization experience in tableau is good to have.
How we’ll support you
- Training and development to help you excel in your career.
- Coaching and support from experts in your team
- A culture of continuous learning to aid progression.
- A range of flexible benefits that you can tailor to suit your needs.
About us and our teams
Please visit our company website for further information:
https://www.db.com/company/company.htm
We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively.
Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.
We welcome applications from all people and promote a positive, fair and inclusive work environment.
Top Skills
Python
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Top Skills:
PysparkScalaSpark
Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
As a Senior Data Engineer, you will design and maintain data solutions, build and optimize data pipelines, and transform raw data into actionable insights. Collaborating with stakeholders, you'll resolve integration issues and manage data infrastructure, while ensuring data security and delivering solutions that empower analytics across the organization.
Top Skills:
PythonSQL
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
As a Senior Data Engineer, you will design and build scalable cloud-based data solutions, manage data pipelines, ensure data quality, and collaborate with various teams to stay updated on cloud technologies and best practices.
Top Skills:
GoJavaPl/SqlPysparkPythonSQL
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
