We are seeking a Senior Test Engineer with expertise in AI/ML systems testing, data validation, and model quality assurance. In this role, you will design and implement strategies to ensure that machine learning models, pipelines, and AI-driven applications meet the highest standards of accuracy, reliability, and fairness.
This position is highly technical, requiring strong experience in testing data-driven workflows, validating ML pipelines, and automating AI-specific test cases. You will collaborate closely with data scientists, ML engineers, and software developers to embed quality checks across the AI lifecycle - from data ingestion to model deployment.
What You’ll Do- Build and maintain automated test frameworks for AI/ML workflows.
- Validate ML models and data pipelines for accuracy, performance, and fairness.
- Design test strategies for training, inference, and drift detection.
- Ensure data quality across ingestion, feature engineering, and post-training.
- Test AI-based APIs and services (NLP, computer vision, generative AI).
- Integrate validation checks into CI/CD and MLOps pipelines.
- Mentor junior QA engineers on AI/ML testing best practices.
- 8+ years in QA/test automation, with 2+ years in AI/ML testing.
- Strong Python skills (Pytest, Pandas, NumPy).
- Hands-on with ML frameworks (TensorFlow, PyTorch, Scikit-learn).
- Familiarity with MLOps tools (Kubeflow, MLflow, SageMaker).
- Experience testing data pipelines (Airflow, Spark, Glue, Kafka).
- Knowledge of API testing (REST/gRPC).
- Strong grasp of CI/CD for ML systems.
- Experience testing LLMs or generative AI.
- Familiarity with vector databases (Pinecone, FAISS, Weaviate).
- Knowledge of AI governance and compliance frameworks.
Exposure to data observability tools (Great Expectations, Monte Carlo).
- Attractive Discretionary Time Off
- Private Medical Insurance with optional dependent coverage
- Educational Assistance Reimbursement Program
- Opportunities for reimbursement for conferences, trainings, and other personal development events
- Maternity and Paternity Leave
- Additional benefits and perks will be shared and discussed with you by the recruiter during the interview process.
Note: The purpose of this profile is to provide a general summary of essential responsibilities for the position and is not meant as an exhaustive list. Assignments may differ for individuals within the same role based on business conditions, departmental need or geographic location.
There’s no perfect candidate. You don't need all the preferred qualifications to make a valuable impact on our team. Our employees and customers come from diverse backgrounds, so if you're passionate about what you could achieve at Vonage, we'd love to hear from you.
To learn how we process your personal data during the recruitment process, please refer to our Privacy Notice.
Who we are:
Vonage is a global cloud communications leader. And your talent will further help brands - such as Airbnb, Viber, WhatsApp, and Snapchat - accelerate their digital transformation through our fully programmable-based unified communications, contact center solutions, and communications APIs. Ready to innovate? Then join us today.
Note: The purpose of this profile is to provide a general summary of essential responsibilities for the position and is not meant as an exhaustive list. Assignments may differ for individuals within the same role based on business conditions, departmental need or geographic location.
