Fold Health Logo

Fold Health

AI/LLM Technical Lead

Posted 3 Days Ago
Be an Early Applicant
In-Office
Pune, Maharashtra, IND
Entry level
In-Office
Pune, Maharashtra, IND
Entry level
Leads the architecture, development, deployment, and monitoring of LLM-based and agentic AI systems for healthcare and operational use cases. Oversees multi-agent orchestration, RAG pipelines, prompt engineering, model evaluation, hallucination mitigation, and cloud deployments. Collaborates with product, engineering, clinical, and customer teams; leads Scrum ceremonies; ensures HIPAA and responsible AI compliance; and mentors and grows the AI engineering team.
The summary above was generated by AI

Responsibilities

  • Lead architecture, design, and implementation of LLM-based and agentic AI systems for clinical and operational use cases.
  • Oversee the development of multi-agent orchestration frameworks (reasoning, planning, and task execution) using tools such as LangGraph, CrewAI, or Semantic Kernel.
  • Build scalable RAG pipelines and retrieval systems using vector databases (Pinecone, FAISS, Weaviate, Vertex AI Matching Engine).
  • Guide engineers on prompt design, model evaluation, multi-step orchestration, and hallucination control.
  • Collaborate with product managers, data engineers, and designers to align AI architecture with business goals.
  • Manage end-to-end AI lifecycle — data ingestion, fine-tuning, evaluation, deployment, and monitoring on Vertex AI / AWS Bedrock / Azure OpenAI.
  • Lead scrum ceremonies, sprint planning, and backlog prioritization for the AI team.
  • Work directly with external stakeholders and customer teams to understand requirements, gather feedback, and translate insights into scalable AI solutions.
  • Ensure compliance with HIPAA, PHI safety, and responsible AI governance practices.
  • Contribute to hiring, mentoring, and upskilling the AI engineering team.


Requirements

Must-Have Skills

  • Deep expertise in LLMs, RAG, and Agentic AI architectures, including multi-agent planning and task orchestration.
  • Hands-on experience with LangChain, LangGraph, CrewAI, or Semantic Kernel.
  • Strong proficiency in Python, cloud-native systems, and microservice-based deployments.
  • Proven track record of leading AI projects from concept to production, including performance optimization and monitoring.
  • Experience working with healthcare data models (FHIR, HL7, clinical notes) or similar regulated domains.
  • Experience leading agile/scrum teams, with strong sprint planning and delivery discipline.
  • Excellent communication and collaboration skills for customer-facing discussions, technical presentations, and cross-team coordination.
  • Deep understanding of prompt engineering, LLM evaluation, and hallucination mitigation.


General Skills

  • Strong leadership, mentorship, and people management abilities.
  • Excellent written and verbal communication for both technical and non-technical audiences.
  • Ability to balance technical depth with product priorities and delivery timelines.
  • Adaptability to fast-changing AI technologies and ability to evaluate new tools pragmatically.
  • A bias toward ownership and proactive problem-solving in ambiguous situations.
  • Empathy for end-users and a commitment to responsible AI in healthcare.


Good to Have

  • Experience leading AI platform initiatives or building internal AI tooling.
  • Exposure to MLOps, continuous evaluation pipelines, and observability tools for LLM systems.
  • Knowledge of multi-modal AI (text + structured + image data).
  • Prior experience integrating AI into production SaaS platforms or healthcare systems.


Benefits

Why Join Fold Health

  • Lead the development of next-generation AI systems transforming healthcare delivery.
  • Collaborate with world-class data, product, and clinical teams on meaningful challenges.
  • Shape the AI roadmap and mentor a growing team of engineers in an innovation-first culture.
  • Work on cutting-edge Agentic AI and LLM applications deployed in real-world healthcare settings.


Similar Jobs

17 Days Ago
In-Office or Remote
2 Locations
Senior level
Senior level
Information Technology
Leads end-to-end development of enterprise AI and LLM applications, including architecture, technical design, Java and Spring Boot backend development, integrations, testing, deployment, and support. Builds generative AI solutions using major LLM providers, prompt engineering, fine-tuning, and agent frameworks. Collaborates with architects and developers to translate designs into scalable microservices, while addressing security, resiliency, databases, containers, Kubernetes, and cloud platforms.
Top Skills: AnthropicAutogenAWSAzureCrewaiDockerFine-TuningGCPGeminiGenerative AiJavaKubernetesLangchainLanggraphLlm IntegrationsMicroservicesOpenaiOraclePrompt EngineeringPythonSpring Boot
17 Days Ago
In-Office or Remote
2 Locations
Mid level
Mid level
Information Technology
Leads technical planning, requirements gathering, estimation, architecture, development, testing, documentation, deployment, and application support for client projects. Mentors developers, provides technical leadership, collaborates with architects and designers, translates creative designs into functional and technical requirements, and communicates effectively with technical and non-technical stakeholders.
Top Skills: Agile MethodologiesArtificial IntelligenceJavaLarge Language Models
17 Days Ago
In-Office or Remote
2 Locations
Senior level
Senior level
Information Technology
Lead technical consultant responsible for the full software development lifecycle, including technical design, implementation, testing, deployment, documentation, and support. Builds enterprise AI and LLM applications using OpenAI, Anthropic, Gemini, agent frameworks, Java, Spring Boot, Python, microservices, databases, containers, Kubernetes, and cloud platforms. Collaborates with architects and developers to translate designs into technical solutions while ensuring security, resiliency, and enterprise architecture standards.
Top Skills: AnthropicAutogenAWSAzureCrewaiDockerFine-TuningGCPGeminiGenerative AiJavaKubernetesLangchainLanggraphLlm IntegrationsMicroservicesOpenaiOraclePrompt EngineeringPythonSpring Boot

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account