Design and build scalable batch and real-time data pipelines using Databricks, PySpark, Structured Streaming, Delta Lake, and Medallion Architecture. Develop reusable ingestion and data quality frameworks, implement ABAC and RBAC security, and build agentic AI workflows using MCP and serverless computing. Create RAG pipelines with vector database integration, while managing governance, lineage, access controls, CI/CD, and LLM evaluation frameworks through Unity Catalog.
Senior Data engineer Key Responsibilities • 7 to 10 years of experience in data engineering and minimum of 3+ years of experience working in Databricks • 4+ years Working in leveraging Pyspark for building reusable Data ingestion and Data quality frameworks • Lakehouse & Data Engineering: Design scalable batch and real-time ETL pipelines using PySpark, Structured Streaming, and Delta Lake built on a Medallion Architecture (Bronze, Silver, Gold). • ABAC and RBAC Security - Experience in setting up ABAC and RBAC security for Agentic AI Journey use cases • Agentic AI & Orchestration: Build autonomous, multi-agent workflows and reasoning loops using MCP Protocol and Serverless compute . • RAG & Vector Integration: Develop end-to-end Retrieval-Augmented Generation (RAG) pipelines and integrate vector databases for semantic retrieval. • Governance & Operations: Manage data lineage, access controls, and security using Unity Catalog alongside CI/CD workflows and LLM evaluation frameworks
Hexaware Technologies Pune, Mahārāshtra, IND Office
North Block, Plot No. 19, Rajiv Gandhi InfoTech Park, MIDC - SEZ, Phase 3, Hinjawadi, Pune, Maharastra, India, 411057
Similar Jobs
Information Technology • Consulting
Design and implement enterprise-scale data platforms, strategies, and modern cloud data architectures. Define architecture standards, build scalable and secure data platforms, and architect end-to-end solutions spanning data ingestion, transformation, storage, governance, analytics, and consumption. The role requires strong hands-on expertise with dbt and Snowflake, along with broad knowledge of the modern data ecosystem.
Top Skills:
Cloud-Native TechnologiesData LakesData WarehousingDbtSnowflake
.jpeg)
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Maintains and troubleshoots semiconductor test equipment, performs preventive maintenance and calibration, monitors equipment and process data, investigates performance deviations, documents activities, communicates issues across engineering and production teams, and supports yield improvement and continuous improvement projects using data and Generative AI insights.
Top Skills:
Generative Ai
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Supports 0–13-week assembly and test execution planning by aligning supply, demand, inventory, and manufacturing capacity. Monitors production plans, inventory, fill rates, delivery performance, and at-risk products; analyzes gaps and root causes; coordinates recovery actions across supply chain, manufacturing, and business teams; and contributes to process improvements, system enhancements, and cross-functional planning initiatives.
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
