EXL Logo

EXL

Lead AI Data Engineer

Posted 14 Days Ago
Be an Early Applicant
Hybrid
Pune, Mahārāshtra, IND
Expert/Leader
Hybrid
Pune, Mahārāshtra, IND
Expert/Leader
Lead design and deliver enterprise-grade GenAI and agentic LLM solutions including RAG pipelines, retrieval systems, prompt engineering, production APIs, guardrails, evaluation frameworks, and mentor engineering teams while partnering with data engineering, MLOps, and product stakeholders.
The summary above was generated by AI

Key Responsibilities

1. Solution Architecture & Technical Leadership

  • Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
  • Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
  • Act as the technical anchor for GenAI initiatives across projects
  • Drive design reviews, architecture governance, and best practices

2. Agentic AI & LLM Engineering

  • Design and build agentic systems using LLMs for use cases such as: 
    • Knowledge assistants
    • Document automation & intelligence
    • Workflow orchestration
  • Implement advanced prompt engineering strategies, prompt orchestration, and reasoning chains
  • Build tool-calling / function-calling frameworks for agent workflows

3. RAG & Retrieval Systems

  • Lead end-to-end implementation of RAG pipelines
    • Data ingestion → chunking → embeddings → vector indexing → retrieval → response generation
  • Optimise retrieval quality (recall, relevance, grounding)
  • Evaluate and benchmark different architectures

4. Productisation & Engineering Excellence

  • Develop production-grade APIs/services (FastAPI, Flask, etc.)
  • Drive code quality, testing standards, and reusable architecture components
  • Ensure solutions are performance optimised (latency, cost, reliability)

5. Governance, Safety & Evaluation

  • Implement LLM guardrails
    • Hallucination control
    • Safety filters
    • Policy enforcement
  • Define evaluation frameworks
    • Response quality metrics
    • RAG benchmarking
    • Human-in-the-loop validation

6. Collaboration & Delivery Leadership

  • Partner with: 
    • Data Engineering → pipelines, data quality, governance
    • MLOps → deployment, CI/CD, monitoring
    • Business/Product → use-case alignment
  • Drive end-to-end delivery ownership across multiple projects

7. Technical Leadership Responsibilities (Critical Addition)

  • Mentor and guide junior engineers and project teams
  • Conduct technical reviews, solution walkthroughs, and code reviews
  • Support pre-sales / RFPs / solution proposals with architecture inputs
  • Drive reusable accelerators, frameworks, and COE assets
  • Stay ahead of industry evolution and help shape EXL’s GenAI strategy
  • Influence technology choice, design decisions, and roadmap planning
 

Must-Have Skills

Experience

  • 9–12 years total experience
  • 2–4+ years hands-on in LLM / GenAI delivery (production use cases)
 

LLM / GenAI & Agentic Engineering

  • Strong hands-on experience with:
    • LLMs (Claude, OpenAI, etc.)
    • RAG pipelines and retrieval optimisation
    • GPT + Agentic AI implementation experience
  • Experience with:
    • LangChain, LangGraph, or similar frameworks
    • Agent orchestration and tool-calling architectures
  • Deep understanding of:
    • LLM limitations, evaluation, and optimisation strategies
 

Core Engineering

  • Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
  • Deep data analysis experience and handling large volume of data
  • Fabric/Azure Databricks/Snowflake data engineering integration skills
  • Good exposure to:
    • Cloud platforms (Azure/AWS/GCP)
    • SQL
    • Containers, CI/CD, monitoring
 

Data / AI Foundations (Mandatory)

Prior experience in one or more:

  • Data Engineering (ETL/ELT, pipelines, orchestration)
  • Data Science / ML lifecycle (especially NLP)
  • Analytics engineering / data products
 

Leadership Capabilities

  • Experience leading solution design or small teams
  • Ability to translate business problems into AI solutions
  • Strong stakeholder communication and influencing skills
 

Good-to-Have / Preferred

  • Fine-tuning approaches: LoRA / PEFT / prompt tuning
  • Experience with Azure AI stack (Azure OpenAI, AI Search)
  • Exposure to: 
    • Enterprise security & data privacy in GenAI
    • Coding agents / autonomous agent frameworks
  • Experience in insurance / BFSI domains (valuable for EXL use cases)
Responsibilities

Key Responsibilities

1. Solution Architecture & Technical Leadership

  • Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
  • Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
  • Act as the technical anchor for GenAI initiatives across projects
  • Drive design reviews, architecture governance, and best practices

2. Agentic AI & LLM Engineering

  • Design and build agentic systems using LLMs for use cases such as: 
    • Knowledge assistants
    • Document automation & intelligence
    • Workflow orchestration
  • Implement advanced prompt engineering strategies, prompt orchestration, and reasoning chains
  • Build tool-calling / function-calling frameworks for agent workflows

3. RAG & Retrieval Systems

  • Lead end-to-end implementation of RAG pipelines
    • Data ingestion → chunking → embeddings → vector indexing → retrieval → response generation
  • Optimise retrieval quality (recall, relevance, grounding)
  • Evaluate and benchmark different architectures

4. Productisation & Engineering Excellence

  • Develop production-grade APIs/services (FastAPI, Flask, etc.)
  • Drive code quality, testing standards, and reusable architecture components
  • Ensure solutions are performance optimised (latency, cost, reliability)

5. Governance, Safety & Evaluation

  • Implement LLM guardrails
    • Hallucination control
    • Safety filters
    • Policy enforcement
  • Define evaluation frameworks
    • Response quality metrics
    • RAG benchmarking
    • Human-in-the-loop validation

6. Collaboration & Delivery Leadership

  • Partner with: 
    • Data Engineering → pipelines, data quality, governance
    • MLOps → deployment, CI/CD, monitoring
    • Business/Product → use-case alignment
  • Drive end-to-end delivery ownership across multiple projects

7. Technical Leadership Responsibilities (Critical Addition)

  • Mentor and guide junior engineers and project teams
  • Conduct technical reviews, solution walkthroughs, and code reviews
  • Support pre-sales / RFPs / solution proposals with architecture inputs
  • Drive reusable accelerators, frameworks, and COE assets
  • Stay ahead of industry evolution and help shape EXL’s GenAI strategy
  • Influence technology choice, design decisions, and roadmap planning
 

Must-Have Skills

Experience

  • 9–12 years total experience
  • 2–4+ years hands-on in LLM / GenAI delivery (production use cases)
 

LLM / GenAI & Agentic Engineering

  • Strong hands-on experience with:
    • LLMs (Claude, OpenAI, etc.)
    • RAG pipelines and retrieval optimisation
    • GPT + Agentic AI implementation experience
  • Experience with:
    • LangChain, LangGraph, or similar frameworks
    • Agent orchestration and tool-calling architectures
  • Deep understanding of:
    • LLM limitations, evaluation, and optimisation strategies
 

Core Engineering

  • Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
  • Deep data analysis experience and handling large volume of data
  • Fabric/Azure Databricks/Snowflake data engineering integration skills
  • Good exposure to:
    • Cloud platforms (Azure/AWS/GCP)
    • SQL
    • Containers, CI/CD, monitoring
 

Data / AI Foundations (Mandatory)

Prior experience in one or more:

  • Data Engineering (ETL/ELT, pipelines, orchestration)
  • Data Science / ML lifecycle (especially NLP)
  • Analytics engineering / data products
 

Leadership Capabilities

  • Experience leading solution design or small teams
  • Ability to translate business problems into AI solutions
  • Strong stakeholder communication and influencing skills
 

Good-to-Have / Preferred

  • Fine-tuning approaches: LoRA / PEFT / prompt tuning
  • Experience with Azure AI stack (Azure OpenAI, AI Search)
  • Exposure to: 
    • Enterprise security & data privacy in GenAI
    • Coding agents / autonomous agent frameworks
  • Experience in insurance / BFSI domains (valuable for EXL use cases)
Qualifications

Key Responsibilities

1. Solution Architecture & Technical Leadership

  • Architect enterprise-grade agentic and LLM solutions (single-agent, multi-agent, tool-driven workflows)
  • Define scalable GenAI system design patterns (RAG, orchestration layers, evaluation frameworks)
  • Act as the technical anchor for GenAI initiatives across projects
  • Drive design reviews, architecture governance, and best practices

2. Agentic AI & LLM Engineering

  • Design and build agentic systems using LLMs for use cases such as: 
    • Knowledge assistants
    • Document automation & intelligence
    • Workflow orchestration
  • Implement advanced prompt engineering strategies, prompt orchestration, and reasoning chains
  • Build tool-calling / function-calling frameworks for agent workflows

3. RAG & Retrieval Systems

  • Lead end-to-end implementation of RAG pipelines
    • Data ingestion → chunking → embeddings → vector indexing → retrieval → response generation
  • Optimise retrieval quality (recall, relevance, grounding)
  • Evaluate and benchmark different architectures

4. Productisation & Engineering Excellence

  • Develop production-grade APIs/services (FastAPI, Flask, etc.)
  • Drive code quality, testing standards, and reusable architecture components
  • Ensure solutions are performance optimised (latency, cost, reliability)

5. Governance, Safety & Evaluation

  • Implement LLM guardrails
    • Hallucination control
    • Safety filters
    • Policy enforcement
  • Define evaluation frameworks
    • Response quality metrics
    • RAG benchmarking
    • Human-in-the-loop validation

6. Collaboration & Delivery Leadership

  • Partner with: 
    • Data Engineering → pipelines, data quality, governance
    • MLOps → deployment, CI/CD, monitoring
    • Business/Product → use-case alignment
  • Drive end-to-end delivery ownership across multiple projects

7. Technical Leadership Responsibilities (Critical Addition)

  • Mentor and guide junior engineers and project teams
  • Conduct technical reviews, solution walkthroughs, and code reviews
  • Support pre-sales / RFPs / solution proposals with architecture inputs
  • Drive reusable accelerators, frameworks, and COE assets
  • Stay ahead of industry evolution and help shape EXL’s GenAI strategy
  • Influence technology choice, design decisions, and roadmap planning
 

Must-Have Skills

Experience

  • 9–12 years total experience
  • 2–4+ years hands-on in LLM / GenAI delivery (production use cases)
 

LLM / GenAI & Agentic Engineering

  • Strong hands-on experience with:
    • LLMs (Claude, OpenAI, etc.)
    • RAG pipelines and retrieval optimisation
    • GPT + Agentic AI implementation experience
  • Experience with:
    • LangChain, LangGraph, or similar frameworks
    • Agent orchestration and tool-calling architectures
  • Deep understanding of:
    • LLM limitations, evaluation, and optimisation strategies
 

Core Engineering

  • Strong Python/Pyspark engineering expertise (production-grade development) with proven API integration experience
  • Deep data analysis experience and handling large volume of data
  • Fabric/Azure Databricks/Snowflake data engineering integration skills
  • Good exposure to:
    • Cloud platforms (Azure/AWS/GCP)
    • SQL
    • Containers, CI/CD, monitoring
 

Data / AI Foundations (Mandatory)

Prior experience in one or more:

  • Data Engineering (ETL/ELT, pipelines, orchestration)
  • Data Science / ML lifecycle (especially NLP)
  • Analytics engineering / data products
 

Leadership Capabilities

  • Experience leading solution design or small teams
  • Ability to translate business problems into AI solutions
  • Strong stakeholder communication and influencing skills
 

Good-to-Have / Preferred

  • Fine-tuning approaches: LoRA / PEFT / prompt tuning
  • Experience with Azure AI stack (Azure OpenAI, AI Search)
  • Exposure to: 
    • Enterprise security & data privacy in GenAI
    • Coding agents / autonomous agent frameworks
  • Experience in insurance / BFSI domains (valuable for EXL use cases)

EXL Pune, Mahārāshtra, IND Office

Pune, India

Similar Jobs

14 Minutes Ago
In-Office
Pune, Mahārāshtra, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead design, development, and deployment of AI/ML solutions to improve health outcomes. Collaborate cross-functionally, follow company policies and employment terms, and adapt to changing assignments, teams, locations, or work arrangements as needed.
18 Minutes Ago
In-Office
Pune, Mahārāshtra, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Lead and mentor data engineering teams to design, build, and optimize scalable batch and real-time data pipelines and platforms. Architect Snowflake- and Azure-based solutions, enforce data governance and compliance (HIPAA/GDPR), implement DevOps/CI/CD and IaC, manage production reliability, and translate business needs into technical designs to drive platform modernization and data accessibility.
Top Skills: AdlsApache AirflowAzure Data Factory (Adf)Azure Event HubsAzure PurviewAzure SynapseCi/CdDockerGitKafkaKubernetesMicrosoft FabricNoSQLPysparkPythonSnowflakeSnowflake Secure SharingSnowflake StreamsSnowpipeSparkSQLTerraform
4 Hours Ago
Hybrid
Pune, Mahārāshtra, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead Sales Operations as a Salesforce SME to optimize CRM data quality, pipeline forecasting, territory planning, case management and AI-driven automation. Partner with Sales, RevOps and cross-functional teams, mentor a Sales Ops team, deliver reporting and playbooks, and drive process simplification to support revenue growth.
Top Skills: Ai ToolsCollaborative ForecastingEtmSales CloudSalesforceSalesforce InspectorSalesforce MapsSalesforce

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account