Lead architecture and development of highly scalable distributed infrastructure services. Define CI/CD, containerization, observability, reliability, and release strategies; troubleshoot production incidents; drive architectural migrations; and mentor engineers across teams. Requires deep Java expertise, large-scale backend systems experience, databases, Docker, Kubernetes, automation, monitoring tools, and strong technical leadership.
System Software Engineer
What you’ll be doing:
What we need to see:
Ways to stand out from the crowd:
NVIDIA is advancing AI and accelerated computing to solve complex challenges across industries. Our Infrastructure organization builds the platforms that power NVIDIA’s engineering teams worldwide. We are looking for an experienced and passionate full-stack engineer to compose, build, and monitor highly scalable distributed services. These services run on thousands of servers and complete millions of automated jobs daily, directly improving the efficiency of thousands of NVIDIA software engineers.
What you’ll be doing:
- Define system architecture and guide development decisions for complex engineering workflows, balancing scalability, reliability, cost, and delivery timelines.
- Lead reviews of system approaches and promote safe, incremental, low-risk rollouts of major infrastructure features across multiple teams.
- Set the strategy for CI/CD pipelines and release practices, enhancing build, test, and deployment speed and quality.
- Support the adoption of containerised services on Docker and Kubernetes, and advocate automation to reduce operational toil.
- Define the observability approach (monitoring, logging, alerting, SLOs) to detect issues early, reduce alert noise, and accelerate incident resolution.
- Lead root-cause analysis of complex production incidents and champion long-term reliability improvements.
- Mentor and grow senior and junior engineers, raise engineering standards, and work closely with teams and collaborators across time zones.
What we need to see:
- BS/MS in Computer Science, Engineering, or equivalent experience, with 5+ years building and operating large-scale backend or distributed systems.
- Deep Java expertise, including concurrency, performance tuning, and debugging complex production issues.
- History of crafting, scaling, and managing large-scale, highly available full-stack applications in production, including leading major architectural changes or migrations.
- Experience in working with Version Control Systems like Gitlab and Gerrit
- Solid grounding in data structures, algorithms, distributed system development, and testing practices.
- Hands-on experience with relational databases (e.g., MySQL) and at least one NoSQL store (e.g., Elasticsearch, MongoDB, Cassandra).
- Experience with Docker and Kubernetes, along with infrastructure automation tools such as Ansible or Chef.
- Experience with one or more monitoring and observability tools (e.g., Prometheus, Grafana, Kibana, Splunk), with a focus on actionable alerts.
- Demonstrated technical leadership: mentoring engineers, influencing roadmaps, and driving cross-team initiatives.
- Strong communication skills and the ability to collaborate across teams and time zones.
Ways to stand out from the crowd:
- Experience taking major infrastructure features from build through incremental production rollout.
- Ability to break complex problems into simple parts and reuse existing solutions.
- SRE approach: using logs and metrics to troubleshoot failures, define SLOs, and improve reliability.
- Experience designing full-stack applications that run well with minimal operational support.
NVIDIA Pune, Mahārāshtra, IND Office
Survey No.144 145, Commerzone No.5, Off, Airport Rd, Yerawada, Pune, Maharashtra, India, 411006
Similar Jobs
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design, develop, and optimize real-time computer vision and vision-language model inference microservices and libraries. Build video ingestion, preprocessing, model serving, integration, and regression testing capabilities. Profile latency, throughput, GPU memory, concurrency, and model accuracy across platforms. Collaborate with engineering and product teams to deliver milestones and own component readiness through release and post-release debugging.
Top Skills:
ArmAsynchronous MessagingCC++ContainersCudaFfmpegNvidia DeepstreamNvidia Nsight SystemsPythonRest ApisRtspTensorrtTriton Inference ServerX86
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Develop and maintain production-quality GPU and display kernel-mode drivers, embedded firmware, and system software for Linux and Android. Implement HDCP and other display-content-protection features, debug hardware-software interoperability issues, and build automated tests and diagnostic tools. The role requires strong C programming, operating-system and concurrency knowledge, low-level debugging, and collaboration with hardware, firmware, security, and external partner teams.
Top Skills:
AndroidCCryptographyDdc/I2CDisplayportDisplayport AuxHardware Security ModulesHdcpHdmiLinuxLinux Drm/KmsNvidia GpuTegraTrusted Execution EnvironmentsUsb-C Displayport Alt Mode
Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
Design, develop, test, debug, and optimize GPU firmware and boot software in resource-constrained environments. Collaborate with hardware, software, OS, and PC vendors to improve GPU startup, security, manageability, and control-plane interfaces. Enhance build systems, regression infrastructure, and firmware security, including root-of-trust capabilities, cryptography, authentication, attestation, and vulnerability mitigation.
Top Skills:
AttestationAuthenticationCChains Of TrustCryptographyDevice BiosGpu FirmwareMctpPciPciePldmRisc-VSpdmUefiX86 Assembly
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
