Gramian Consulting Group Logo

Gramian Consulting Group

AI Annotation Quality Reviewer

Posted 4 Days Ago
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
Leads quality assurance for AI training data by managing review queues, auditing annotations, monitoring quality trends, coaching reviewers, clarifying guidelines, training new team members, identifying recurring errors, and escalating complex issues. The role also supports corrective actions and continuous improvement while ensuring accurate, consistent, and timely project delivery.
The summary above was generated by AI

About Gramian

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.

About the Role

We are seeking a detail-oriented QA Review Team Lead to oversee quality assurance activities for AI training data and ensure annotated outputs are accurate, consistent, and delivered on time. In this role, you will lead QA reviewers, manage audit and review queues, assess annotation quality, identify recurring errors, and provide clear, actionable feedback to improve team performance. You will also train new reviewers, clarify guidelines for annotators, and escalate complex or recurring issues to the Senior QA Lead. The ideal candidate combines strong quality assurance skills with experience mentoring team members and applying detailed guidelines in a fast-paced environment.

CONTRACT: Contractor assignment, 16 weeks

COMMITMENT: Hourly, up to 40h/week

LOCATIONS: Remote - Brazil, Colombia, India

Key Responsibilities

  • Lead QA reviewers and manage audit and review queues to ensure timely and accurate completion of assigned work.
  • Spot-check annotated data and reviewer decisions to verify compliance with project guidelines and quality standards.
  • Provide clear, actionable, and consistent feedback to reviewers and annotators.
  • Conduct office hours and clarify annotation guidelines, review criteria, and quality expectations.
  • Monitor quality scores, error trends, audit results, and reviewer performance.
  • Train and onboard new reviewers on project guidelines, tools, and review procedures.
  • Identify recurring errors, inconsistencies, and process gaps, and recommend corrective actions.
  • Escalate persistent quality issues, unclear guidelines, and complex cases to the Senior QA Lead.
  • Support continuous improvement of review processes and maintain consistent quality across the team.

Requirements
  • 3–5 years of overall professional experience, including at least 1 year of experience leading, mentoring, or supervising reviewers or team members.

  • Strong attention to detail and the ability to apply complex guidelines consistently.

  • Excellent written and verbal communication skills.

  • Ability to provide constructive, actionable feedback and explain quality expectations clearly.

  • Strong organizational skills and the ability to manage multiple review queues and competing deadlines.

  • Ability to identify patterns in errors and support corrective actions.

  • Availability to work the specified schedule for the full 16-week project.

Similar Jobs

2 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Leads multiple aerospace datalink product development teams in Bangalore, overseeing avionics system and software design, program execution, budgets, quality, delivery, and customer support. Drives Agile transformation, cost and cycle-time reduction, digital engineering initiatives, innovation, common avionics products, strategic planning, talent development, and performance culture. Requires deep avionics expertise, aerospace software development experience, knowledge of DO-178B/C and ARP4754A, and substantial people and technical leadership.
Top Skills: AgileAIArp4754AAutomationAvionicsDigital ThreadDigital TwinHoneywell Operating SystemLean Product DevelopmentModel-Based Systems Engineering (Mbse)Rtca Do-178B/C
5 Hours Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the technical direction for Atlassian’s multi-cloud Kubernetes, compute, and AI/ML infrastructure platform. Design fleet architectures, Kubernetes control planes, operators, progressive delivery, workload isolation, autoscaling, and cost optimization. Drive reliability, security, compliance, and AI infrastructure capabilities across GPU clusters, networking, and parallel filesystems. Lead cross-team initiatives, influence global engineering leaders, establish architectural standards, and mentor senior engineers.
Top Skills: Amazon Fsx For LustreArgocdAWSAws EfaCncfCrossplaneEksFedrampFirecrackerGCPGcp ParallelstoreGitopsGkeGoGpudirectGvisorInfinibandInfrastructure As CodeJavaKubernetesLustrePythonRdmaTerraform
5 Hours Ago
In-Office or Remote
Senior level
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and ship native Android security and audit features for Atlassian Guard. Own mobile capabilities from design through testing, rollout, and production support while partnering with backend, platform, and product teams. Improve performance, reliability, and developer experience; protect sensitive customer data; contribute to frontend web work when needed. The role requires Kotlin, Android architecture, testing, CI/CD, authentication protocols, and reactive programming expertise.
Top Skills: AndroidAndroid StudioCi/CdEspressoGitGradleJunitKotlinOauthOidcRxandroidRxjavaSAML

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account