Design and develop AI Agents, optimizing their performance and integrating them into enterprise ecosystems, while mentoring junior engineers and ensuring compliance.
Company Description
It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone.
Job Description
What you get in the role:
We are looking for a highly skilled Senior Staff Software Engineer - AI to design, develop, and optimize next-generation AI Agents that power intelligent automation and enhance user experiences. This role requires deep expertise in large language models (LLMs), prompt engineering/tuning, agent orchestration, and performance optimization. You will partner with product managers, data scientists, and engineering teams to architect scalable AI-driven solutions and integrate them into our enterprise ecosystem.
Key Responsibilities
• Architecture Design: Define and design end-to-end architecture for AI agents, ensuring scalability, reliability, and security in enterprise environments.
• AI Agent Development: Design, build, and deploy autonomous AI agents capable of handling complex tasks with minimal human intervention.
• Prompt Tuning & Optimization: Develop advanced prompt engineering strategies, fine-tune LLMs, and optimize model outputs for accuracy, reliability, and efficiency.
• Agent Integration: Architect and implement frameworks for integrating multiple AI agents and external systems, ensuring seamless workflows and interoperability, having experience with protocols like MCP.
• Performance Engineering: Continuously measure, evaluate, and enhance the performance, scalability, and reliability of AI agents.
• Innovation & Research: Stay ahead of AI/ML advancements (LLMs, multi-agent systems, reasoning engines, retrieval-augmented generation, vector databases, etc.) and apply them to real-world use cases.
• Collaboration & Leadership: Mentor junior engineers, contribute to technical roadmaps, and drive cross-functional collaboration with product and platform teams.
• Governance & Compliance: Ensure responsible AI practices, model interpretability, and compliance with data security and ethical guidelines.
• Strong Platform/Product mindset, with the ability to think beyond features and focus on building reusable, scalable solutions.
• Strong problem-solving skills and ability to architect large-scale AI systems.
Qualifications
To be successful in this role you have:
• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or related field.
• 15+ years of software engineering experience with at least 5+ years in AI/ML systems.
• Proven hands-on experience in building and deploying AI agents, LLM-based applications, or conversational AI systems.
• Strong expertise in LLMs (OpenAI, Anthropic, Llama, etc.), vector databases (Pinecone, FAISS, Weaviate), RAG pipelines, and multi-agent frameworks.
• Proficiency in Python and frameworks such as LangChain, LlamaIndex, Hugging Face Transformers, Ray, or similar.
• Experience with prompt engineering, fine-tuning, and evaluation methodologies.
• Deep knowledge of cloud platforms (AWS, GCP, Azure) and MLOps practices.
• SaaS exposure with a clear understanding of platform scalability, multi-tenancy, and product lifecycle management.
• Strong Platform/Product mindset, with the ability to think beyond features and focus on building reusable, scalable solutions.
• Strong problem-solving skills and ability to architect large-scale AI systems.
Additional Information
Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here . To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. ©2025 Fortune Media IP Limited. All rights reserved. Used under license.
It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today - ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone.
Job Description
What you get in the role:
We are looking for a highly skilled Senior Staff Software Engineer - AI to design, develop, and optimize next-generation AI Agents that power intelligent automation and enhance user experiences. This role requires deep expertise in large language models (LLMs), prompt engineering/tuning, agent orchestration, and performance optimization. You will partner with product managers, data scientists, and engineering teams to architect scalable AI-driven solutions and integrate them into our enterprise ecosystem.
Key Responsibilities
• Architecture Design: Define and design end-to-end architecture for AI agents, ensuring scalability, reliability, and security in enterprise environments.
• AI Agent Development: Design, build, and deploy autonomous AI agents capable of handling complex tasks with minimal human intervention.
• Prompt Tuning & Optimization: Develop advanced prompt engineering strategies, fine-tune LLMs, and optimize model outputs for accuracy, reliability, and efficiency.
• Agent Integration: Architect and implement frameworks for integrating multiple AI agents and external systems, ensuring seamless workflows and interoperability, having experience with protocols like MCP.
• Performance Engineering: Continuously measure, evaluate, and enhance the performance, scalability, and reliability of AI agents.
• Innovation & Research: Stay ahead of AI/ML advancements (LLMs, multi-agent systems, reasoning engines, retrieval-augmented generation, vector databases, etc.) and apply them to real-world use cases.
• Collaboration & Leadership: Mentor junior engineers, contribute to technical roadmaps, and drive cross-functional collaboration with product and platform teams.
• Governance & Compliance: Ensure responsible AI practices, model interpretability, and compliance with data security and ethical guidelines.
• Strong Platform/Product mindset, with the ability to think beyond features and focus on building reusable, scalable solutions.
• Strong problem-solving skills and ability to architect large-scale AI systems.
Qualifications
To be successful in this role you have:
• Bachelor's or Master's degree in Computer Science, Artificial Intelligence, Machine Learning, or related field.
• 15+ years of software engineering experience with at least 5+ years in AI/ML systems.
• Proven hands-on experience in building and deploying AI agents, LLM-based applications, or conversational AI systems.
• Strong expertise in LLMs (OpenAI, Anthropic, Llama, etc.), vector databases (Pinecone, FAISS, Weaviate), RAG pipelines, and multi-agent frameworks.
• Proficiency in Python and frameworks such as LangChain, LlamaIndex, Hugging Face Transformers, Ray, or similar.
• Experience with prompt engineering, fine-tuning, and evaluation methodologies.
• Deep knowledge of cloud platforms (AWS, GCP, Azure) and MLOps practices.
• SaaS exposure with a clear understanding of platform scalability, multi-tenancy, and product lifecycle management.
• Strong Platform/Product mindset, with the ability to think beyond features and focus on building reusable, scalable solutions.
• Strong problem-solving skills and ability to architect large-scale AI systems.
Additional Information
Work Personas
We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here . To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service.
Equal Opportunity Employer
ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements.
Accommodations
We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance.
Export Control Regulations
For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.
From Fortune. ©2025 Fortune Media IP Limited. All rights reserved. Used under license.
Top Skills
Ai Agents
AWS
Azure
GCP
Hugging Face Transformers
Langchain
Llamaindex
Llms
Python
Ray
Vector Databases
Similar Jobs at ServiceNow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The role involves defining product roadmaps for operational technology in industrial environments, collaborating with engineering and UX teams, and understanding market challenges for effective product management.
Top Skills:
AIAPIsComputer NetworksCybersecurityData ManagementEnterprise ApplicationsIndustrial Control SystemsSaaSServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Senior Platform Administrator will manage ServiceNow environments, troubleshoot issues, provide training, and work on system upgrades and documentation. Collaborating with teams, the role focuses on continuous improvement and maintaining high service standards.
Top Skills:
CmdbGlide ScriptingItomItsmJavaScriptMid ServersMySQLOraclePerformance AnalyticsRest ApisServicenowSoap ApisSplunk
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Staff Technical Program Manager manages complex infrastructure projects in cloud environments, ensuring timely delivery and operational readiness while coordinating with architecture and engineering teams.
Top Skills:
AnsibleAWSAzureCfengineChefCloud InfrastructureGCPLinuxLogstashMariadbMySQLOraclePuppetSplunk
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
