NVIDIA Logo

NVIDIA

Senior Software Engineer, RAG and Agentic AI

Reposted Yesterday
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Senior level
In-Office
Pune, Maharashtra, IND
Senior level
The role involves building scalable RAG solutions, optimizing workflows, collaborating on product features, and ensuring software quality. Requires expertise in AI applications and Python.
The summary above was generated by AI

NVIDIA has been transforming computer graphics, PC gaming, and accelerated computing for more than 25 years. It’s a unique legacy of innovation that’s fueled by great technology—and amazing people. Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPU acts as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent. As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is inspired to do their best work.

We are looking for a Senior Software Engineer to join our AI Blueprints team to build multimodal, scalable, production-grade reference RAG solutions. In this role you will build the next-generation RAG architecture using Agentic AI and NVIDIA Nemotron models and develop orchestration layers to dynamically interact with proprietary unstructured and structured data sources. If you are creative and passionate about real-world enterprise AI challenges, come join us.

What you’ll be doing:

  • Plan, build and refine a GPU-accelerated, scalable, configurable Retrieval Augmented Generation (RAG) workflow and optimize it for accuracy, relevance, grounding and performance.

  • Design and implement AI agents to enhance RAG pipeline which are capable of reasoning, planning, multi-step execution, and collaboration across tools and services

  • Run fast, high-quality POCs on emerging agent and RAG architectures; harden successful patterns into generalized, reusable implementations and integrate them as part of production software.

  • Build and deploy a disaggregated, end-to-end RAG pipeline using on-prem microservices architecture, orchestrating complex, multi-service deployments from local Docker environments to enterprise-scale Kubernetes clusters.

  • Drive the continuous improvement of the pipelines by rigorously evaluating system accuracy, characterizing performance metrics across components, analyzing the data and recommending actionable strategic enhancements."

  • Collaborate with various teams on new product features and the improvement of existing product. Provide guidance and support to NVIDIA internal teams and external partners on domain-adaptation, customization and integration of the RAG pipeline.

  • Champion engineering excellence by leading rigorous code, architecture, and test plan reviews, authoring robust user documentation, and driving collaborative problem-solving and triage initiatives.

  • Drive software excellence by designing with clean architectural patterns and automating the path to production through advanced CI/CD, testing, and telemetry workflows.

What we need to see:

  • 5+ years of professional software engineering experience, with deep expertise in Python, and AI applications.

  • Bachelor's degree or Master’s degree (or equivalent experience) in Computer Science, Electrical Engineering, Data Science, Artificial Intelligence or other related fields

  • Hands-on experience building and deploying LLM-powered AI applications or RAG or Agentic AI workflows.

  • Strong understanding of LLM design patterns, including tool calling, prompt engineering, structured outputs, reasoning.

  • Experience with agent frameworks or orchestration systems such as LangGraph, LangChain, OpenAI Agents SDK, or similar.

  • Have working experience with microservices, Docker, Helm, Kubernetes.

  • Experience with end-to-end software lifecycle, release packaging, and CI/CD pipelines.

  • Strong collaborative and interpersonal skills, specifically a proven ability to effectively guide and influence within a dynamic environment involving teams across the globe.

Ways to stand out from the crowd:

  • Experience designing multi-agent systems and sophisticated workflow orchestration engines.

  • Familiarity with evaluation frameworks, MLOps pipelines, and AI observability tooling.

  • Background in deploying AI models on data center, cloud, and embedded systems.

  • Strong python programming skills and experience of working with AI coding agents.

NVIDIA is committed to encouraging a diverse work environment and is proud to be an equal opportunity employer. We highly value diversity in our current and future employees. We do not discriminate in hiring or promotion based on race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other legally protected characteristic.

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/

Top Skills

AI
Ci/Cd
Docker
Helm
Kubernetes
Llm
Python

NVIDIA Pune, Mahārāshtra, IND Office

Survey No.144 145, Commerzone No.5, Off, Airport Rd, Yerawada, Pune, Maharashtra, India, 411006

Similar Jobs

4 Minutes Ago
Remote or Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Design, develop, and maintain Salesforce solutions across Sales, Service, and Experience Clouds including CPQ. Perform Apex and LWC development, unit testing, deployments (Gearset), integrations, and support SOX-compliant change management while collaborating with global teams.
Top Skills: ApexChange SetsExperience CloudFlowGearsetGitJIRALightning Web Components (Lwc)Process BuilderRest ApiSales CloudSalesforce CpqSalesforce Data LoaderSalesforce DxService CloudSoap ApiSOQLSoslValidation RulesVisualforce
4 Minutes Ago
Remote or Hybrid
Pune, Maharashtra, IND
Mid level
Mid level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
Contribute to the development and monitoring of ML and LLM-based security models, including data acquisition, model evaluation, and deployment on AWS infrastructure.
Top Skills: AWSBedrockCloudwatchGithub ActionsHuggingface TransformersJenkinsLambdaLangchainNumpyPandasPythonPyTorchS3SagemakerScikit-LearnTensorFlow
4 Minutes Ago
Remote or Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
As a Senior Software Engineer in Test, you will ensure product quality through testing strategies, developing automation frameworks, and mentoring junior members.
Top Skills: AWSCucumberGoJavaJIRANunitPlaywrightPythonRobotframeworkSelenium

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account