NVIDIA Logo

NVIDIA

Senior Software Engineer, RAG and Agentic AI

Reposted 19 Days Ago
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level
The role involves building scalable RAG solutions, optimizing workflows, collaborating on product features, and ensuring software quality. Requires expertise in AI applications and Python.
The summary above was generated by AI

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.

We are looking for a Senior Software Engineer to join our AI Blueprints team to build multimodal, scalable, production-grade reference RAG solutions. In this role you will build the next-generation RAG architecture using Agentic AI and NVIDIA Nemotron models and develop orchestration layers to dynamically interact with proprietary unstructured and structured data sources. If you are creative and passionate about real-world enterprise AI challenges, come join us.

What you’ll be doing:

  • Plan, build and refine a GPU-accelerated, scalable, configurable Retrieval Augmented Generation (RAG) workflow and optimize it for accuracy, relevance, grounding and performance.

  • Design and implement AI agents to enhance RAG pipeline which are capable of reasoning, planning, multi-step execution, and collaboration across tools and services

  • Run fast, high-quality POCs on emerging agent and RAG architectures; harden successful patterns into generalized, reusable implementations and integrate them as part of production software.

  • Build and deploy a disaggregated, end-to-end RAG pipeline using on-prem microservices architecture, orchestrating complex, multi-service deployments from local Docker environments to enterprise-scale Kubernetes clusters.

  • Drive the continuous improvement of the pipelines by rigorously evaluating system accuracy, characterizing performance metrics across components, analyzing the data and recommending actionable strategic enhancements."

  • Collaborate with various teams on new product features and the improvement of existing product. Provide guidance and support to NVIDIA internal teams and external partners on domain-adaptation, customization and integration of the RAG pipeline.

  • Champion engineering excellence by leading rigorous code, architecture, and test plan reviews, authoring robust user documentation, and driving collaborative problem-solving and triage initiatives.

  • Drive software excellence by designing with clean architectural patterns and automating the path to production through advanced CI/CD, testing, and telemetry workflows.

What we need to see:

  • 5+ years of professional software engineering experience, with deep expertise in Python, and AI applications.

  • Bachelor's degree or Master’s degree (or equivalent experience) in Computer Science, Electrical Engineering, Data Science, Artificial Intelligence or other related fields

  • Hands-on experience building and deploying LLM-powered AI applications or RAG or Agentic AI workflows.

  • Strong understanding of LLM design patterns, including tool calling, prompt engineering, structured outputs, reasoning.

  • Experience with agent frameworks or orchestration systems such as LangGraph, LangChain, OpenAI Agents SDK, or similar.

  • Have working experience with microservices, Docker, Helm, Kubernetes.

  • Experience with end-to-end software lifecycle, release packaging, and CI/CD pipelines.

  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic environment involving teams across the globe.

Ways to stand out from the crowd:

  • Experience designing multi-agent systems and sophisticated workflow orchestration engines.

  • Familiarity with evaluation frameworks, MLOps pipelines, and AI observability tooling.

  • Background in deploying AI models on data center, cloud, and embedded systems.

  • Strong python programming skills and experience of working with AI coding agents.

NVIDIA is committed to encouraging a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees. We do not discriminate in hiring or promotion based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected characteristic.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

NVIDIA Pune, Mahārāshtra, IND Office

Survey No.144 145, Commerzone No.5, Off, Airport Rd, Yerawada, Pune, Maharashtra, India, 411006

Similar Jobs

14 Days Ago
In-Office
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
The role involves developing and optimizing a scalable RAG workflow, implementing AI agents, and enhancing pipelines through collaboration while ensuring system performance and accuracy.
Top Skills: Agentic AiAICi/CdDockerHelmKubernetesLlmPythonRag
13 Minutes Ago
In-Office
Senior level
Senior level
Fintech • Information Technology • Financial Services
The VP of Product will lead the Enterprise Data Platform by developing the product vision, collaborating with teams, managing the product lifecycle, and ensuring user satisfaction through effective engagement and performance monitoring.
Top Skills: AhaCloud-Based Data PlatformsIt Service ManagementMicrosoft AdoMiroPlatform-As-A-ServicePowerPointProduct Management ToolsVisio
6 Hours Ago
Easy Apply
Remote or Hybrid
India
Easy Apply
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
The Senior Creative Design and Media Specialist will produce high-quality collateral across various media, ensure branding alignment, and collaborate with teams to create effective design solutions.
Top Skills: Adobe Creative SuiteFigmaGoogle SlidesMS Office

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account