HighLevel Logo

HighLevel

Software Development Engineer in Test III - AI

Reposted 3 Days Ago
Remote
Hiring Remotely in India
Senior level
Remote
Hiring Remotely in India
Senior level
Lead the planning and execution of test strategies, develop automated test suites for UI and API, and mentor junior team members.
The summary above was generated by AI
About HighLevel:
HighLevel is an AI-powered business operating system that gives agencies, entrepreneurs and SMBs the infrastructure to build, automate and scale. Today, HighLevel supports SMBs across 150+ countries, fueling community-driven growth rooted in real customer outcomes.
To date, businesses operating on HighLevel have generated over $7 billion in ecosystem value, demonstrating the impact of shared infrastructure at scale. By centralizing conversations, automation and intelligence into one system, we help businesses move faster, reduce complexity and execute efficiently.
Behind the platform, HighLevel powers more than 4 billion API hits and 2.5 billion message events daily. With 250 terabytes of distributed data, 250+ microservices and over 1 million domain names supported, our architecture is built for performance, resilience and long-term scalability.
Our People
With over 2,000 team members across 10+ countries, HighLevel operates as a global, remote-first organization built for speed and ownership. We value initiative, clarity and execution, creating space for ambitious people to build systems that support millions of businesses worldwide. Here, innovation thrives, ideas are celebrated and people come first, no matter where they call home.
Our Impact
Every month, HighLevel enables more than 1.5 billion messages, 200 million leads and 20 million conversations for the more than 1 million businesses we support. Behind those numbers are real people building independence, expanding opportunity and creating measurable impact. We’re proud to be a part of that.
Learn more about us on our YouTube Channel or Blog Posts
 
About the Role:
We are looking for a Senior Software Development Engineer in Test (SDET 3) with strong expertise in AI tools and testing AI-driven products. This role requires a hands-on individual who can design and execute test strategies for AI systems, automate intelligently, and mentor junior team members. You will work independently, drive tasks to closure, and play a key role in ensuring the quality of our AI initiatives.

Requirements:

  • 5+ years of overall experience in QA/SDET roles
  • Proven experience working with AI tools (e.g., OpenAI, Claude, or similar LLM platforms)
  • Strong understanding of testing AI/ML products and their unique challenges
  • Hands-on knowledge of RAG pipelines and their testing methodologies
  • Proficiency in automation frameworks (e.g., Playwright, Cypress, Selenium, or similar)
  • Experience with API testing (Postman, REST, GraphQL, gRPC)
  • Strong problem-solving skills with the ability to work independently
  • Mentorship and leadership skills in guiding peers or junior engineers

Responsibilities:

  • Design, develop, and maintain automation frameworks and test strategies for AI products
  • Test and validate AI-powered features (including OpenAI, Claude, and other AI integrations)
  • Evaluate and improve RAG (Retrieval-Augmented Generation) flows, ensuring accuracy and performance
  • Leverage AI automation tools to optimize test coverage and efficiency
  • Collaborate closely with developers, product managers, and AI researchers to ensure high-quality releases
  • Own tasks end-to-end, working independently to deliver on commitments.
  • Mentor and guide junior SDETs, fostering a culture of quality and continuous learning

Nice to have

  • Experience with CI/CD pipelines and cloud platforms (AWS/GCP/Azure)
  • Familiarity with MLOps pipelines and monitoring AI systems
  • Exposure to performance and scalability testing of AI workloads

EEO Statement:

The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government recordkeeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
We encourage you to review our Privacy Policy before submitting your application

Similar Jobs

An Hour Ago
In-Office or Remote
Pune, Maharashtra, IND
Senior level
Senior level
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Lead the Autonomous Sourcing product strategy for Coupa Sourcing, designing AI agents and deterministic workflows to automate sourcing lifecycle events, negotiation, and award analysis. Partner with AI researchers, engineering, and enterprise procurement leaders to deliver market-differentiated, guardrailed agentic automation and drive go-to-market positioning and executive evangelism.
Top Skills: Agentic AutomationAi/MlApi-Driven OrchestrationAutonomous AgentsLlmsRetrieval-Augmented Generation (Rag)
5 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Own and operate virtualized IaaS platforms (KVM, VMware, OpenStack, public cloud). Lead IaC (Terraform, Packer, Ansible) and automation, maintain R&D environments, perform incident RCA, participate in on-call rotation, document processes, and improve developer experience and reliability.
Top Skills: AIAnsibleAWSAzureBitbucketGCPGitGitlabLinuxmacOSOpenstackPackerPythonQemu/KvmTerraformVmware VcenterWindowsXen
5 Hours Ago
In-Office or Remote
Junior
Junior
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Drive outbound prospecting into a defined India territory to qualify leads and book pipeline-generating meetings. Conduct cold calls, emails, and research; use AI tools for personalization and prioritization. Collaborate with sales, marketing, partners and operations, navigate objections, articulate product value, and manage pipeline with Account Executives using Salesforce, Gong, Outreach and LinkedIn Navigator.
Top Skills: Ai ToolsGongLinkedin NavigatorOutreachSalesforce

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account