Lead QA for autonomous AI voice agents by designing advanced voice testing methodologies. Validate ASR, NLU, latency, TIA execution, prompt configurations, LLM hallucinations, telephony integrations (Amazon Connect/Genesys), and Salesforce Flow/VoiceCall data consistency.
Role Overview:
We are seeking an analytical and technically sharp Agentforce QA Engineer specializing in Voice Testing to lead the quality assurance and validation of our autonomous AI voice systems. In this role, you will do much more than execute standard manual test scripts — you will design and implement advanced testing methodologies for modern, next-generation AI interactions. You will leverage the Agentforce Testing Center, Service Cloud Voice infrastructure, and prompt valuation techniques to ensure our real-time voice-activated agents provide precise, secure, and natural customer experiences.
Responsibilities:
We are seeking an analytical and technically sharp Agentforce QA Engineer specializing in Voice Testing to lead the quality assurance and validation of our autonomous AI voice systems. In this role, you will do much more than execute standard manual test scripts — you will design and implement advanced testing methodologies for modern, next-generation AI interactions. You will leverage the Agentforce Testing Center, Service Cloud Voice infrastructure, and prompt valuation techniques to ensure our real-time voice-activated agents provide precise, secure, and natural customer experiences.
Responsibilities:
- Validate voice-enabled autonomous agents using the Agentforce Testing Center, testing reasoning traces, conversational turn-taking, and Topic/Instruction/Action (TIA) execution accuracy.
- Conduct comprehensive Voice Testing within the Voice Preview engine and via telephony endpoints, evaluating Automatic Speech Recognition (ASR) mapping, latency, and Natural Language Understanding (NLU) accuracy.
- Audit and test Prompt Builder configurations, executing variance and regression tests to identify potential LLM hallucinations, off-script deviations, or scoring drops.
- Verify end-to-end integration flows across Service Cloud Voice telephony connections (e.g., Amazon Connect, Genesys), ensuring seamless call routing, transcription generation, and real-time human agent escalation pathways.
- Validate back-end data consistency by verifying that voice interactions trigger the appropriate Salesforce Flows, update standard fields, and successfully log data into VoiceCall records.
- Salesforce Certified Agentforce Specialist
- Salesforce Certified AI Specialist / AI Associate
- Any equivalent Salesforce Consultant or Service Cloud Voice certification (a major plus given telephony routing and contact center setup validation requirements)
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Design, develop, and maintain microservices-based Python applications and REST APIs. Implement asynchronous processing, ensure test coverage and code quality, deploy and operate services in Docker/Kubernetes, contribute to CI/CD pipelines, mentor junior engineers, collaborate with cross-functional teams, and optimize performance, scalability, and reliability.
Top Skills:
CeleryDjangoDjango Rest FrameworkDockerFastapiGit/GitlabGitlab CiJenkinsKubernetesMongoDBNoSQLPostgresPythonRabbitMQRedisSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead business analysis for Risk Weighted Assets (RWA) and Counterparty Credit Risk (CCR) initiatives. Translate Basel III/IV and SA-CCR/IMM/EAD regulatory requirements into BRDs, FRDs, user stories, process flows and data mappings. Liaise with Market Risk, CCR, Regulatory Reporting, Finance, Quant and Technology teams to support capital calculations, RWA optimization and regulatory reporting for transformation programs.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design and develop web applications and UI/UX solutions, collaborate with stakeholders to define technical solutions, implement Python and JavaScript components, evaluate visualization tools and recommend approaches, deliver quality work in Agile teams under tight deadlines.
Top Skills:
JavaScriptPython
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
