Cognition Logo

Cognition

QA Engineer

Posted 2 Days Ago
Be an Early Applicant
Remote or Hybrid
Hiring Remotely in India
Senior level
Remote or Hybrid
Hiring Remotely in India
Senior level
This role involves ensuring product quality for AI workflows through testing strategies, debugging, and building QA processes to enhance software performance.
The summary above was generated by AI
We are an applied AI lab building end-to-end software agents.

We're the makers of Devin, the first AI software engineer, and Windsurf, the AI-native IDE. Together, they represent our vision for collaborative AI teammates that enable engineers to focus on more interesting problems and empower teams to strive for more ambitious goals.

Our team is small and talent-dense. Among our founding team, we have world-class competitive programmers, former founders, and leaders from companies at the cutting edge of AI including Scale AI, Palantir, Cursor, Waymo, Tesla, Lunchclub, Modal, Google DeepMind, and Nuro.

Building Devin and Windsurf is just the first step—our hardest challenges still lie ahead. If you’re excited to solve some of the world’s biggest problems and build AI that can reason on real-world tasks, apply to join us.

About the Role

Key Responsibilities
  • Own end-to-end product quality across AI workflows: Test Windsurf and Devin across onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows—thinking like a developer and testing like a user.

  • Design and execute comprehensive test strategies: Build and run functional, regression, integration, exploratory, and E2E test plans across product surfaces and releases.

  • Break down complex flows into testable scenarios: Identify edge cases, race conditions, state recovery failures, and real-world usage patterns that only emerge in production-like behavior.

  • Issue reproduction, documentation, and debugging: Reproduce, document, and debug issues across layers—distinguishing between UI defects, orchestration/system issues, and unexpected AI behavior; work with engineering and product to drive resolution.

  • Release readiness and quality bar ownership: Partner with engineering and product to define “done,” set quality standards, and ensure releases meet the expectations of real developers.

  • Build scalable QA processes and automation: Establish QA playbooks, test processes, and automation where it has leverage; help evolve CI/CD and testing practices as the product scales.

Qualifications

Must-Have
  • 5+ years of QA/Test Engineering experience testing complex product workflows (multi-step user journeys, cross-surface interactions, and E2E behavior).

  • Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.

  • Strong developer mindset: comfortable reading/writing code (Python, TypeScript, or similar), navigating codebases, and reasoning about systems.

  • User-first testing approach: you test from the perspective of real users, not just against a spec.

  • Exceptional attention to detail and strong debugging instincts; able to communicate clearly and precisely in bug reports and triage.

  • Familiarity with CI/CD and test automation frameworks; comfort working in fast-moving, release-driven environments.

  • Schedule flexibility: overlap with US time zones required; release cycles may require weekend availability.

Strong Plus
  • Experience testing AI-powered products with non-deterministic outputs; ability to evaluate quality when responses vary.

  • Experience testing IDE plugins/extensions or developer tools (VS Code extensions, CLIs, code review systems).

  • Familiarity with AI coding tools (Windsurf, Copilot, Cursor, Devin, etc.) and informed opinions on what “good” looks like.

  • Prior software engineering background with shipped production code.


Top Skills

Python
Typescript

Similar Jobs

3 Days Ago
Remote
India
Junior
Junior
Edtech • Software
Test SCORM 1.2 eLearning packages in a custom LMS: verify completion, scoring, navigation, resume behavior, and runtime-LMS communication. Test across browsers/devices, report defects in bug trackers, write test cases/checklists, and perform regression, functional, and UI/UX testing while collaborating with developers and designers.
Top Skills: Azure DevopsChrome DevtoolsCSSHTMLJIRALmsScorm 1.2XML
4 Days Ago
Remote
India
Mid level
Mid level
Information Technology • Consulting
Work with Product and Engineering to design and execute manual and automated tests, build and maintain automation scripts, log and investigate bugs, create test plans and cases, and improve test coverage and product quality across UI, API, performance, and usability.
Top Skills: Python,Javascript,Ui Testing,Api Testing,Jmeter,Loadrunner,Ci/Cd,Automation Frameworks
5 Days Ago
Easy Apply
Remote
India
Easy Apply
Mid level
Mid level
Natural Language Processing • Software • Conversational AI
Execute manual testing across web and mobile UI and backend systems. Create test plans, perform API and exploratory testing, validate workflows and data integrity, document defects, collaborate with Product and Engineering, support release readiness, and help improve QA processes and automation coverage.
Top Skills: Postman,Sql,Jira,Playwright,Cypress,Nightwatch,Selenium,Gitlab,Java,Javascript

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account