Design, build, and maintain scalable ETL/data pipelines and data management blueprints. Ingest, transform, and curate large complex datasets for analytics, support cloud (AWS) implementations, enable downstream consumers, and provide technical leadership and operational support to ensure data governance, quality, and automation.
Data Engineer - GCH -
Job Description
- Assist in designing and implementing scalable and robust processes for ingesting and transforming complex datasets.
- Designs, develops, constructs, maintains and supports data pipelines for ETL from a multitude of sources.
- Creates blueprints for data management systems to centralize, protect, and maintain data sources.
- Focused on data stewardship and curation, the data engineer enables the data scientist to run their models and analyses to achieve the desired business outcomes
- Ingest large, complex data sets that meet functional and non-functional requirements.
- Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.
- Design and build bulk and delta data lift patterns for optimal extraction, transformation, and loading of data.
- Supports the organisation’s cloud strategy and aligns to the data architecture and governance including the implementation of these data governance practices.
- Engineer data in the appropriate formats for downstream customers, risk and product analytics or enterprise applications.
- Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.
- Work with various stakeholders across the organization to understand data requirements and apply technical knowledge of data management to solve key business problems.
- Provide support in the operational environment with all relevant support teams for data services.
- Provide input into the management of demand across the various data streams and use cases.
- Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.
- Support test and deployment of new services and features.
- Provides technical leadership to junior data engineers in the team
MINIMUM QUALIFICATIONS/EXPERIENCE (REQUIRED FOR THE JOB)
- Matric, with a degree in Computer Science, Business Informatics, Mathematics, Statistics, Physics or Engineering.
- 4+ years of data engineering experience
- 4+ years of experience with any data warehouse technical architectures, ETL/ELT, and reporting/analytics tools including , but not limited to , any of the following combinations (1) SSIS ,SSRS or something similar (2) ETL Frameworks, (3) Spark (4) AWS data builds
- The candidate having DBA ability and knowledge across at least 2 platforms (example: TSQL, SAS, PSQL, IBM VSAM, DynamoDB and DB2) will also be beneficial.
- Should be at least at a proficient level in at least one of Python or Java
- Should be Proficient in bash SQL
- Some experience with R, AWS, XML, json, cron will be beneficial
- Experience with designing and implementing Cloud (AWS) solutions including use of APIs available.
- Some experience with Dev/OPS architecture, implementation and operation would be advantageous.
- Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data.
- Some experience in applying SAFe/Scrum/Kanban methodologies.
- Knowledge and understanding of business process management lifecycle which covers the design, modelling, execution, monitoring, and optimization as well as business process re-engineering.
- Good problem solving skills: The ability to exercise judgment in solving technical, operational, and organizational challenges, to identify issues proactively, to present solutions and options leading to resolution
Qualifications
Data Engineer
Zensar Technologies Pune, Mahārāshtra, IND Office
Zensar Knowledge Park, Kharadi, Plot # 4, MIDC, Pune, Maharashtra, India, 411014
Zensar Technologies Pune, Maharashtra, IND Office
Pune, India
Similar Jobs
Information Technology
Build and maintain data pipelines using Databricks, Python, SQL, and Spark. Apply data modeling, cloud data services, version control, and CI/CD practices. Support streaming pipelines, workflow orchestration, data governance, security controls, and downstream BI requirements. Experience with AWS or Azure is required, while Databricks certification, streaming technologies, orchestration tools, and Power BI exposure are preferred.
Top Skills:
Adls Gen2Amazon EmrAmazon KinesisAmazon S3Apache AirflowApache KafkaSparkAWSAws GlueAzure Data FactoryAzure Event HubsAzure SynapseCi/CdDatabricksDatabricks WorkflowsDelta LakeGitAzurePower BIPysparkPythonSQLStructured Streaming
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Supports aerospace engine and APU systems engineering across requirements development, MBSE architecture, integration, verification, and validation. Develops traceable requirements and SysML models, performs functional decomposition and interface definition, supports trade studies and technical reviews, and collaborates with design, software, controls, safety, reliability, test, and certification teams. Contributes to system integration, test planning, requirements traceability, issue investigation, technical documentation, and MBSE process improvement.
Top Skills:
Arp4754AArp4761CameoDo-160Enterprise ArchitectIbm Doors NgJamaMagicdrawPolarionRhapsodySysml
Artificial Intelligence • Consumer Web • Edtech • HR Tech • Information Technology • Software • Conversational AI
Manages multiple customer-facing professional services engagements, including Percipio platform implementations, integrations, and learning delivery projects. Ensures projects meet scope, schedule, budget, quality, and business objectives. Responsibilities include developing project plans, coordinating cross-functional resources, managing risks and changes, tracking progress, communicating status, and overseeing complex customer portfolios. The role requires billable consulting experience, strong virtual collaboration skills, and the ability to manage multiple projects across time zones.
Top Skills:
Learning Content Management Systems (Lcms)Learning Management Systems (Lms)ExcelMicrosoft OutlookMicrosoft PowerpointMicrosoft ProjectMicrosoft TeamsMicrosoft WordPercipioPlatform As A Service (Paas)
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
