This role involves defining and executing the test strategy for a CX assurance platform, implementing automated tests, and improving test infrastructure.
Cyara is the world’s leading Automated CX Assurance Platform provider, helping leading brands across the globe deliver better CX with less effort, cost, and risk. Cyara supports the entire CX software development lifecycle, from design to functional and regression testing, load testing, chatbot testing, and production monitoring, ensuring enterprises can build flawless customer journeys across voice and digital channels while reducing the risk of customer-facing defects. Every day, the most recognizable brands across the globe trust Cyara to deliver customer smiles at scale. Interested to find out more about us? Check out: www.cyara.com
Want to know what it’s really like to work at Cyara? Check out this link to meet some real Cyaran’s and read about their individual career journey with us: https://cyara.com/employee-profiles/
Cyara’s Diversity, Equity, Inclusive and Belonging Statement:
At Cyara, we are dedicated to fostering a workplace that embodies equal opportunity and champions diversity, equity, inclusion, and belonging (DEIB). We strive to cultivate an environment where every individual feels valued, respected, and empowered to bring their whole selves to work, contributing unique perspectives and talents. Our commitment includes continuously evaluating and enhancing our policies, practices, and culture to align with our DEIB principles. We ensure a discrimination-free environment where individuals are evaluated solely on their merits and abilities, regardless of legally protected statuses such as sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, gender identity, veteran status, or medical condition. By celebrating our differences and championing inclusivity, we enrich our organization, make more thoughtful decisions, and drive collective success.
Cyara’s Values Statement: At Cyara, our values shape everything we do. We're passionate about Delivering Excellence by putting the customer first, collaborating globally, and always striving to improve. We take smart risks and Innovate Boldly, setting new standards and learning from every experience. Integrity First is our cornerstone—we value humility, authenticity, and respect for diversity, building trust in all we do. We Embrace Curiosity by empowering you to experiment, learn, and grow in a dynamic environment. At Cyara, our values drive us forward, shaping a culture where innovation and excellence thrive.
Key Responsibilities
- Define, own, and execute the end-to-end test strategy for the CX assurance platform, ensuring high test coverage, efficiency, and scalability.
- Design and implement automated test cases that evaluate:
- The quality and variance of outputs from deep insights and analytics of training models.
- The reliability and reasoning in AI trust tests, including hallucination detection, grounding, and consistency.
- Build and maintain automated test frameworks using JavaScript/TypeScript, Node.js, React, and Cypress.
- Monitor and analyze test results, identify regressions, and proactively drive resolution.
- Continuously improve test infrastructure and CI/CD pipeline integration to ensure fast, reliable feedback loops.
Required Skills and Qualifications
- Technical Expertise
- Strong proficiency in JavaScript/TypeScript, with hands-on experience in Node.js and React applications.
- Deep experience with end-to-end testing frameworks, especially Cypress.
- Working knowledge of machine learning fundamentals and model evaluation techniques.
- Familiarity with k-fold cross-validation, precision/recall/F1 metrics, and analyzing model performance across datasets.
- Understanding of AI trustworthiness principles such as interpretability, robustness, and bias detection.
- Proven experience owning the test strategy for complex systems, including planning, execution, and test architecture.
- Ability to define coverage metrics, assess test gaps, and drive toward measurable quality goals.
- Experience working in agile/Scrum environments, actively participating in story grooming and sprint planning.
- Strong analytical and problem-solving skills with attention to detail.
- Excellent communication skills for cross-functional collaboration.
- A mindset of ownership, initiative, and continuous improvement.
AI/ML & Data Science Knowledge
Test Strategy and Leadership
Soft Skills
Why you should join us:
At Cyara you’ll have the opportunity to work with a group of people who share common goals, are driven by a similar passion, and value the expertise of their peers. Cyara is committed to being an equal opportunity employer, focused on building and maintaining a diverse, inclusive and authentic workplace; and a work environment that is free from discrimination and harassment, based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy. At Cyara we appreciate and welcome the fact that our culture is living and growing as we continue to evolve over time. With this opportunity comes the chance to enjoy a flexible work environment, competitive compensation and a work culture that's results-oriented, fast-paced and focused on continuous improvement, whilst maintaining a family first, team oriented, and ever positive atmosphere.
Cyara cares for its own - you’ll feel that on your first day - and you'll get the chance to work for a global, growing company, and an all-inclusive team of innovators. We credit our amazing growth and success to the fact that we’ve built our business on four essential values that we live and breathe every day:
Deliver Excellence
Innovate Boldly
Integrity First
Embrace Curiosity
Interested? Know someone who might be? Apply online now.
Agencies: Thanks but we’ve got this one! Please, no phone calls or emails to any employees of Cyara outside of the Talent Acquisition team. Cyara’s policy is to only accept resumes from Agencies via the Cyara Agency Portal. Agencies must have a valid fee agreement in place and they must have been assigned the specific requisition to which they submit resumes, by the Cyara Talent Acquisition team before submitting any CV's. Any resume submitted outside of this process will be deemed the sole property of Cyara and, in the event, a candidate is submitted outside of this policy is hired, no fee or payment of any kind will be paid
Top Skills
Cypress
JavaScript
Node.js
React
Typescript
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Lead cybersecurity integration initiatives, mentor teams, manage planning and performance, optimize systems, and collaborate on global engineering efforts.
Top Skills:
AIAzureConfiguration Management PlatformsCybersecurity ToolsLinux
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Support Account Manager will ensure customer satisfaction and service delivery, driving communication with high-profile clients and managing support-related activities.
Top Skills:
AIItilItsmServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Responsible for enhancing software delivery infrastructure, driving product strategy for the Developer Experience suite, and collaborating across teams to ensure product innovation and performance.
Top Skills:
AIAutomationConfiguration ManagementDeveloper Experience ToolsMonitoring SystemsRelease EngineeringSoftware Engineering
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
