Maintain and optimize production LLM/VLM services and microservices (Flask/FastAPI), manage async queues, deploy and monitor Uvicorn/Gunicorn hosts, integrate LLM routing tools, design prompt strategies, build feedback/evaluation pipelines, expose secure REST APIs, and track token usage, latency, and errors to ensure SaaS-grade AI performance.
Role Overview
We are looking for an AI Engineer to maintain and enhance the AI-driven backbone of the Sootra platform. This role involves ensuring production stability of LLM/VLM pipelines, optimizing model interactions, maintaining APIs and queues, and building feedback loops that continuously improve AI outputs.
Responsibilities
- Maintain and optimize LLM- and VLM-powered services for content generation, compliance scoring, and campaign testing.
- Manage and scale Flask/FastAPI microservices, ensuring high uptime and low latency.
- Maintain Dramatiq queues for async AI workflows, campaign generation, and pipeline orchestration.
- Deploy, monitor, and debug Uvicorn/Gunicorn-based hosting in production environments.
- Integrate with OpenRouter and equivalent LLM routing tools to balance cost, latency, and quality.
- Design and refine prompt engineering strategies for reliability, context-awareness, and compliance.
- Build and maintain feedback pipelines for AI model evaluation (human-in-the-loop scoring, automated quality checks, reinforcement).
- Expose and maintain REST APIs for AI services, ensuring secure, versioned endpoints.
- Collaborate with backend/frontend teams to keep microservice architecture aligned and maintainable.
- Track token consumption, latency, and error rates to ensure production-grade performance.
Required Skills
- Programming: Strong in Python, with experience in production-grade codebases.
- Frameworks: Flask (for APIs), FastAPI (optional), Uvicorn/Gunicorn for async hosting.
- Queues/Workers: Dramatiq (or Celery/RQ equivalent) for background jobs.
- AI/ML: Hands-on with LLMs and VLMs, including prompt engineering, fine-tuning, and evaluation.
- AI Infrastructure: Familiar with OpenRouter or equivalent LLM/VLM routing & fallback tools.
- Architecture: Experience designing and maintaining microservice architectures.
- APIs: Strong experience with REST API design (auth, rate limiting, documentation).
- Production: Dockerized deployments, CI/CD pipelines, logging/monitoring, error handling.
- Feedback Loops: Building structured evaluation/feedback systems for AI model performance.
- Cloud: AWS/GCP experience preferred (deployment, monitoring, scaling).
Experience
- 3–5 years as an AI Engineer or Python Backend Engineer working with production systems.
- Prior work with SaaS platforms, LLM/VLM integrations, or AI-first products is highly valued.
Demonstrated ability to maintain AI pipelines in production, not just prototypes.
Similar Jobs
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Designs and implements multi-cloud security controls, policy-as-code guardrails, IAM and network protections, container and Kubernetes security, vulnerability remediation, and incident response tooling. Partners with engineering, IT, compliance, and risk teams on audits and control validation. The role also mentors security engineers, supports root-cause analysis, improves response runbooks, and participates in on-call rotations.
Top Skills:
AWSAzureBashCi/CdContainer SecurityEdrGCPIamInfrastructure As CodeJavaScriptKubernetesNaclsOrganizations/ScpsPythonVpcVulnerability Scanning
Artificial Intelligence • Fintech • Information Technology • Logistics • Payments • Business Intelligence • Generative AI
Supports cloud, application, infrastructure, container, and Kubernetes security engineering. Contributes to multi-cloud controls, IAM policies, policy-as-code guardrails, vulnerability triage, compliance evidence gathering, security automation, and secure AI system monitoring. The role also involves scripting, documentation, root-cause analysis, and collaboration with Engineering, IT, Compliance, and senior security engineers.
Top Skills:
AWSAzureBashCi/CdContainer SecurityFedrampGCPIamInfrastructure As CodeIso 27001JavaScriptKubernetesNetwork AclsOrganizations/ScpsPci-DssPolicy As CodePythonSecurity GroupsSoc 2VpcVulnerability Scanning
Information Technology
Design end-to-end digital product experiences through user research, interaction design, wireframing, prototyping, visual design, and design systems. Collaborate with product, engineering, and business stakeholders to create accessible, responsive web and mobile interfaces. Conduct usability testing, incorporate feedback and analytics, present design concepts, and support accurate implementation across multiple initiatives.
Top Skills:
A/B TestingAdobe Creative SuiteComponent LibrariesCSSDesign SystemsFigjamFigmaHTMLProduct AnalyticsWcag
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
