Lead design and delivery of enterprise data warehouse solutions: architect and optimize ETL/ELT pipelines (SAP BODS, DataStage), build scalable data models, tune SQL/Oracle performance, enforce data governance/security, mentor engineers, collaborate with BI and stakeholders, and support L3 production operations with rotational shift coverage.
Senior Data Engineer
Primary Skills
- CI/CD Pipeline, CSS/SCSS/LESS, PyTest, PostgreSQL / MongoDB / Redis, REST API / GraphQL
Specialization
- Python Fullstack with Microservices: Software Development Lead
Job requirements
We are seeking an experienced Lead Data Engineer to take end-to-end ownership of Enterprise Data Warehouse (EDW) solutions. This role will be responsible for designing, architecting, and optimizing scalable, secure, and high-performance data pipelines using SAP BODS, IBM DataStage, Redwood, SQL, Oracle, and modern data platforms.
The ideal candidate will combine strong hands-on technical expertise with leadership capabilities to drive data engineering best practices and deliver enterprise-grade data solutions aligned with business objectives.
Key Responsibilities
1. EDW Architecture & Data Engineering
- Design and implement scalable data integration and transformation frameworks for the Enterprise Data Warehouse.
- Architect and optimize ETL/ELT pipelines using SAP BODS and IBM DataStage.
- Develop and maintain robust data models (Star/Snowflake schemas, SCD implementation).
- Ensure high availability, reliability, and performance of data pipelines.
- Implement data governance, security, and compliance standards.
- Develop complex data workflows and transformations.
- Perform performance tuning of ETL jobs and SQL queries.
- Optimize batch processing and scheduling using Redwood.
- Implement error handling, logging, and monitoring mechanisms.
- Manage incremental loads and data reconciliation processes.
- Write and optimize complex SQL queries, stored procedures, and functions.
- Work extensively with Oracle databases and related technologies.
- Design and manage indexing strategies and query optimization.
- Support database performance analysis and tuning.
- Lead and mentor a team of data engineers.
- Conduct code reviews and enforce development standards.
- Drive technical best practices and architecture governance.
- Collaborate with cross-functional teams including BI, Analytics, and Application teams.
- Participate in sprint planning, estimation, and technical roadmap discussions.
- Work closely with business stakeholders to gather and translate requirements into technical solutions.
- Provide technical guidance and solution recommendations.
- Ensure alignment between enterprise data strategy and business goals.
- Support production issue resolution and root cause analysis.
- Strong experience with SAP BODS
- Hands-on experience with IBM DataStage
- Experience with Redwood scheduling
- Advanced SQL development
- Strong expertise in Oracle database
- Deep understanding of Enterprise Data Warehouse architecture
- Data modeling (Star/Snowflake schema, SCD Types)
- ETL/ELT best practices
- Data quality frameworks
- Performance tuning and optimization
- Data security and governance standards
- Experience with modern cloud data platforms (Azure, AWS, GCP)
- Knowledge of Snowflake, Databricks, or Synapse
- CI/CD implementation for data pipelines
- Exposure to data cataloging and metadata management tools
- Experience in Agile/Scrum methodologies
- Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.
- 5+ years of experience in Data Engineering.
- 2+ years of experience in leading technical teams.
- Strong architectural and analytical skills
- Leadership and mentoring capability
- Excellent communication and stakeholder management
- Problem-solving mindset
- Ability to drive enterprise-scale data initiatives
2. ETL Development & Optimization
3. Database & SQL Development
4. Leadership & Team Management
5. Stakeholder Collaboration
Required Skills
Technical Expertise
Data Engineering Concepts
Preferred / Good to Have
Qualifications
Key Competencies
Please Note
- This is L3 support project
- Flexibility to work in rotational shift is mandatory
Brillio Pune, Mahārāshtra, IND Office
Pune, India
Similar Jobs
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Lead a small analytics team to gather, analyze, and present market and financial intelligence for the U.S. Financial Services vertical. Perform data extraction (SQL), build BI dashboards and visualizations, conduct market research, prepare financial forecasts and business cases, and communicate insights to inform strategy and client solutions.
Top Skills:
ExcelPowerPointPythonRSASSQLTableauWord
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Own UK STDF actuals and stress testing outputs end-to-end, manage risk and control frameworks, maintain regulatory inventories, drive remediation in Helios, coordinate governance and approvals, prepare BCST 2027 readiness artifacts, and lead continuous improvement and automation of stress testing processes.
Top Skills:
HeliosSharepoint
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Deliver FP&A Global MI change projects: gather requirements, produce process maps and documentation, manage SIT/UAT testing, support implementation and training, manage risks/issues, and liaise with Finance stakeholders to drive finance systems and reporting improvements.
Top Skills:
BigQueryCloudConfluenceExcelMicrosoft PowerpointMicrosoft TeamsMicrosoft VisioMicrosoft WordOnenotePythonQlikSaracenSharepointSQLTm1
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
