Rifa AI Logo

Rifa AI

Client QA & Operations Analyst

Posted 8 Hours Ago
Be an Early Applicant
In-Office or Remote
Hiring Remotely in India
Junior
In-Office or Remote
Hiring Remotely in India
Junior
Audit AI agent call and chat transcripts against quality and compliance standards, identify regressions and edge cases, document actionable engineering issues, and participate in client QA and audit calls. Reconcile internal findings with client audits, explain performance data, and provide recurring quality insights to the Technical Program or Product Manager for release communications and client reviews.
The summary above was generated by AI
About us

Rifa AI is building the AI agents platform for contact centers in regulated industries.

Enterprises in these industries want AI agents handling their customer operations and mostly can't deploy them. It's not a model problem. Horizontal platforms lack governance, release processes, and change management, and in a domain where every call can be reviewed by a regulator, that's disqualifying. Building an AI agent has never been easier. Deploying one an enterprise can trust has never been harder. That harder problem is the one we work on.

Our platform turns a company's written procedures into AI agents: voicebots that hold real-time conversations, take actions in the client's CRM, and stay within the limits the client has set. Every release is gated by an automated testing suite, and every conversation feeds a post-analysis platform. We're live in production today, handling debt collection calls for US financial services clients.

The engineering convictions behind it: evaluation methodology, not model capability, is the bottleneck. Every rule and decision trace becomes part of a company's context graph. Observability goes beyond logging. And our Agent Studio lets engineers, non-engineers, and auditors collaborate to build and improve AI agents with the right guardrails to achieve the expected business outcomes.

Rifa was founded by Sameer Fulzele (IIT Bombay). We're a small team of exceptionally capable, passionate engineers with paying enterprise clients and growing revenue, backed by Seaborne Capital, a founder-first firm of exceptional industry operators that works closely with its founders, and by angel investors who are veterans of enterprise software and operators in the accounts receivable industry.

About the role

This is the hands-on quality and operations role behind our enterprise client relationships. You'll live in the transcripts and performance data: auditing how our AI agents handle real client conversations, catching issues before and after clients do, and turning what you find into clear, actionable work for the engineering team.

You'll be client-facing: on audit calls, walking client-side QA and compliance teams through findings, and reconciling our read of bot performance with theirs. It's a role for someone precise, curious, and organized, comfortable with data and detail, and confident explaining what they found and why it matters.

You'll report to the Technical Program / Product Manager, who owns the overall client relationship, and you'll be their eyes and ears on day-to-day quality.

What you'll do
  • Audit transcripts and bot performance. Review call and chat transcripts in Reflect, our observability platform, evaluate how our AI agents performed against quality and compliance standards, and score conversations consistently and fairly.

  • Find and document issues. Spot regressions, compliance gaps, mishandled flows, and edge cases in agent behavior, and document them clearly, with the transcript or metric as evidence.

  • Convey issues to engineering. Translate what you find into well-written Linear cards that engineers can act on without a follow-up call: clear repro steps, the affected conversation, and why it matters to the client.

  • Get on client calls. Join client QA and audit calls, walk their teams through findings, and answer questions on how our agents are performing.

  • Reconcile audits with the client. Compare our QA findings against the client's own audit team's results, work through discrepancies, and align on a shared, defensible view of quality.

  • Support the client relationship. Feed insights, recurring issues, and trends back to the Technical Program / Product Manager to inform release communications, weekly syncs, and monthly reviews.

What you'll bring
  • 1 to 3 years in QA, operations, quality analysis, delivery support, or a similar client-facing role, ideally at a B2B SaaS, BPO, or financial-services company.

  • Comfort with data and transcripts as evidence. You can read a call log or a QA scorecard, form your own view, and back it up, not just relay what someone else said.

  • Clear written and spoken English. A large share of this job is written: issue tickets, audit notes, and client-facing summaries that hold up under scrutiny.

  • US-hours overlap. Reliable daily overlap with US business hours (ET/CT), which in practice means a late-afternoon-into-evening IST schedule, and comfort being on a call with a client's ops or compliance team.

  • Precision and follow-through. You're organized, detail-oriented, and you close the loop on what you find.

Even better...
  • Experience in debt collections, lending, or another regulated financial-services domain, or familiarity with FDCPA / compliance workflows

  • Hands-on experience with QA tooling, call-quality scoring, or observability/audit dashboards

  • Familiarity with Linear (or similar issue trackers like Jira) and how good engineering tickets are written

  • An interest in AI / conversational systems and how they behave in production

How we work

Small teams per client, with real ownership. We review each other's work, we write things down, and we'd rather hear an honest "I don't know yet" than a confident wrong answer.

Our values
  • Trust: We do the right thing, especially when nobody is checking. Clients hand us regulated conversations with their own customers, and we earn that every day.

  • Transparency: We write things down, share the real numbers, and say "I don't know yet" out loud, with each other and with clients.

  • Technically best solution: We choose what's right, not what's easiest or trendiest. When we notice we got it wrong, we fix it.

  • Decisiveness: We decide quickly with the information we have, commit, and correct course fast when reality disagrees.

  • Simplicity: We keep systems, processes, and words simple. Complexity is a cost we pay only when it clearly buys something.

Similar Jobs

5 Hours Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Operate and maintain specialty gas, bulk gas, and chemical distribution systems supporting semiconductor manufacturing. Perform preventive, corrective, and breakdown maintenance; respond to alarms; troubleshoot equipment; support installations and commissioning; complete work orders and inspections; follow EHS, LOTO, PPE, and chemical safety procedures; and contribute to reliability, TPM, predictive maintenance, and continuous improvement initiatives.
Top Skills: Bulk Gas SystemsChatgptChemical/Gas Distribution SystemsClaudeCmmsCopilotGas Monitoring And Alarm SystemsGenaiLarge Language Models (Llms)LotoMS OfficeSap PmSpecialty Gas SystemsTpm
5 Hours Ago
Remote
Gujarat, IND
Senior level
Senior level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Lead module manufacturing planning using AI-enabled tools and data insights to optimize weekly/tactical plans, manage KPIs and inventory, coordinate cross-functional and external partners, support NPI and capacity adjustments, drive continuous improvement in utilization, cost and cycle time, and build/coach a team of product planners.
5 Hours Ago
Remote
Gujarat, IND
Entry level
Entry level
Artificial Intelligence • Hardware • Information Technology • Machine Learning
Maintains, calibrates, and troubleshoots semiconductor test equipment; monitors equipment performance and process metrics; documents issues; communicates deviations to engineering, production, and maintenance teams; supports preventive maintenance, failure analysis, safety procedures, yield improvement, and continuous improvement projects. Uses data and AI-enabled methods to investigate problems and optimize equipment and processes.
Top Skills: Agentic AiAi-Enabled SolutionsEquipment Tracking SystemsTest Equipment

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account