Advantest Logo

Advantest

Test Automation Engineer - AI Solutions

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in IND
Mid level
Remote
Hiring Remotely in IND
Mid level
Develop and maintain automated test frameworks for GenAI applications, AI agents, MCP-based solutions, APIs, integrations, and distributed software. Create test plans and cases, execute manual and automated testing, analyze results, manage defects, and support release validation. Work in Linux environments using Python, Shell, Docker, CI/CD, and related tools. Collaborate with developers, architects, DevOps, and product teams to improve test coverage, reliability, quality metrics, and end-to-end software performance.
The summary above was generated by AI
Job Summary & Responsibilities
If you want to directly shape the future, this is your opportunity. Advantest is one of the world’s leading providers of automatic test equipment for the semiconductor industry. We work closely with leading companies in emerging markets. Almost any modern AI, cloud, or embedded system is based on semiconductor devices that have been tested with our products.
We are looking for a Test Automation Engineer AI Solutions with strong experience in Linux, Python-based test automation, software testing, and testing of AI-based solutions. The role focuses on developing and maintaining automated test environments, defining and executing test strategies, and ensuring the quality and reliability of GenAI applications, MCP-based solutions, interfaces, integrations, and large-scale software applications.
 
Key Responsibilities
• Test automation: Design, develop, and maintain automated test frameworks and reusable test components for functional, interface, integration, regression, and system-level testing. Develop automated tests for GenAI applications, AI agents, and MCP-based solutions.
• Test planning and execution: Translate product requirements into test scenarios and test cases. Maintain test plans and strategies, execute manual and automated tests, analyze results, and track defects through resolution.
• AI, interface, and integration testing: Test GenAI-based functionality, MCP servers and clients, tool integrations, APIs, and interfaces between distributed software components. Validate functional behavior, error handling, reliability, and end-to-end workflows.
• Linux and test infrastructure: Work with Linux-based development and test environments, application configurations, deployment environments, and test infrastructure. Develop automation using Python and Shell scripting and support Docker-based workflows.
• Test results and development integration: Consolidate test results, generate test reports and quality metrics, and improve test coverage and release quality. Work closely with developers, architects, DevOps engineers, and product teams and support release validation.
Preferred Qualifications
'Required Qualifications
• Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field, with 3+ years of experience in software testing and test automation.
• Strong experience with Linux, Python, Shell scripting, and automated test frameworks, including manual and automated testing methods.
• Good knowledge of interface, API, integration, end-to-end, and system testing, including testing across distributed software components.
• Experience with Docker, CI/CD and build tools such as Jenkins and Bazel, and source control systems such as Git and Bitbucket.
• Strong understanding of test strategies, test design, defect management, debugging, and troubleshooting, with experience working in Agile/Scrum development environments.
 
Preferred Skills
• Experience testing GenAI applications, AI agents, LLM-based applications, and MCP-based solutions, including MCP servers, clients, tools, and their integration with external systems.
• Knowledge of Advantest V93000 (93K) and SmarTest 8 (SMT8).
• Experience with AI-assisted or AI-native software development workflows.
• Experience testing complex enterprise or distributed applications, including API, interface, integration, and end-to-end testing.
• Exposure to performance and scalability testing, cloud-based test environments, and test reporting or quality dashboards.
• Experience with security testing of LLM applications (e.g. OWASP Top 10 for LLM Applications: prompt injection, insecure tool use, data leakage).
 
Personal Skills
• Strong analytical, debugging, and problem-solving skills.
• Clear communication and effective collaboration with software development teams.
• Ability to work independently, take ownership of tasks, and maintain a strong focus on software quality.
 

Similar Jobs

33 Minutes Ago
Remote
India
Entry level
Entry level
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Develop and support Pfizer’s generative AI platform, with a focus on building and operating an LLM gateway. The provided description contains no additional responsibilities, qualifications, compensation, travel, or clearance details.
Top Skills: GenaiLarge Language Models (Llms)Llm Gateway
33 Minutes Ago
Remote or Hybrid
India
Expert/Leader
Expert/Leader
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads integrated buy-side and sell-side network strategy for Pfizer’s external CMO and CentreOne supply networks. Develops strategic roadmaps, evaluates network footprint, capacity, capabilities, resilience, sourcing, and exits, and identifies cross-network synergies. Governs network strategy processes, operating models, data tools, and reporting while partnering with procurement, operations, quality, finance, supply chain, business development, and leadership. Uses analytics and AI tools to translate network intelligence into strategic decisions and supports growth initiatives in a global regulated pharmaceutical environment.
Top Skills: Artificial IntelligenceExcelMicrosoft 365Microsoft CopilotNetwork Intelligence ToolsPower BIPowerPoint
4 Hours Ago
Remote or Hybrid
India
Entry level
Entry level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Manage strategic projects from initiation through delivery, defining scope, timelines, deliverables, and success metrics. Track progress, risks, and reporting while facilitating governance meetings and senior leadership updates. Prepare executive presentations and synthesize business performance, project updates, KPIs, and transformation milestones into data-driven narratives. Partner with senior stakeholders across business, finance, operations, risk, technology, analytics, and BI teams, using dashboards and reports to support decision-making.
Top Skills: Power BISap Businessobjects

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account