Xenon Seven Logo

Xenon Seven

Gen AI Tester

Posted 5 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
The Generative AI Tester will validate AI-driven features, ensure model reliability, and drive testing workflows across enterprise applications, requiring over 5 years experience in software testing and 2-3 years in Generative AI systems.
The summary above was generated by AI
Description
Description

About us:

Where elite tech talent meets world-class opportunities!

At Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources allows us to partner with clients on transformative initiatives, driving innovation and business growth. Whether it's empowering global organizations or collaborating with trailblazing startups, we are committed to delivering advanced, impactful solutions that meet today’s most complex challenges.

We are building a community of top-tier experts and we’re opening the doors to an exclusive group of exceptional AI & ML Professionals ready to solve real-world problems and shape the future of intelligent systems.

Requirements

Job Description – Generative AI Tester (5+ Years Experience)

Role Overview

We are seeking a skilled and proactive Generative AI Tester with over 5 years of experience in software testing and quality assurance, including 2–3 years focused on Generative AI systems. The ideal candidate will be responsible for validating AI-driven features, ensuring model reliability, and driving end-to-end testing workflows across enterprise-grade applications.

Key Responsibilities

  • Collaborate with product, data science, and engineering teams to understand AI use cases and define test strategies.
  • Design and execute test cases for LLM-based features such as summarization, classification, conversational flows, and content generation.
  • Validate model outputs for factual accuracy, tone, relevance, and compliance with domain-specific standards.
  • Develop automated test scripts and frameworks for prompt-response validation and regression testing.
  • Evaluate ML models using metrics like precision, recall, F1-score, and domain-specific thresholds.
  • Conduct integration testing across cloud platforms (e.g., AWS, Azure, GCP) and data environments (e.g., Snowflake, Databricks).
  • Document test results, anomalies, and improvement suggestions in structured formats.
  • Ensure ethical AI practices and compliance with data governance policies.

Required Skills & Experience

  • 5+ years in software testing, QA, or data validation roles.
  • 2–3 years hands-on experience testing Generative AI models (e.g., GPT, LLaMA, Claude).
  • Strong proficiency in Python and experience with ML testing tools or frameworks.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and data engineering environments (Snowflake, Databricks).
  • Understanding of ML workflows including time series, regression, classification, and neural networks.
  • Excellent communication skills and ability to drive cross-functional discussions with ownership.

Preferred Qualifications

  • Exposure to domain-specific AI applications (e.g., pharma, healthcare, finance).
  • Experience with prompt engineering and LLM evaluation frameworks.
  • Knowledge of ethical AI principles and regulatory compliance (e.g., HIPAA, GDPR).

Top Skills

AWS
Azure
Databricks
GCP
Python
Snowflake

Similar Jobs

An Hour Ago
Remote or Hybrid
KA, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The ITAM Analyst will manage the lifecycle of corporate-owned IT assets, promote IT asset management strategies, analyze asset impact, and collaborate with procurement for cost-effective terms.
Top Skills: IaitamItilServicenowSoftware Asset Management
5 Hours Ago
In-Office or Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a team of Site Reliability Engineers to build and scale Cloud infrastructure, coach technical leaders, and contribute to the engineering strategy.
Top Skills: Agile Software DevelopmentCloud InfrastructureMicroservices
7 Hours Ago
In-Office or Remote
Bengaluru, Karnataka, IND
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Mid-Market Customer Success Manager will help customers maximize value from Atlassian products, build relationships, and develop success plans to achieve business objectives.
Top Skills: ConfluenceGainsightJIRASalesforceTableau

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account