Leads the architecture, development, deployment, and monitoring of LLM-based and agentic AI systems for healthcare and operational use cases. Oversees multi-agent orchestration, RAG pipelines, prompt engineering, model evaluation, hallucination mitigation, and cloud deployments. Collaborates with product, engineering, clinical, and customer teams; leads Scrum ceremonies; ensures HIPAA and responsible AI compliance; and mentors and grows the AI engineering team.
Responsibilities
- Lead
architecture, design, and implementation of LLM-based and agentic AI
systems for clinical and operational use cases.
- Oversee
the development of multi-agent orchestration frameworks (reasoning,
planning, and task execution) using tools such as LangGraph, CrewAI, or
Semantic Kernel.
- Build
scalable RAG pipelines and retrieval systems using vector
databases (Pinecone, FAISS, Weaviate, Vertex AI Matching Engine).
- Guide
engineers on prompt design, model evaluation, multi-step orchestration,
and hallucination control.
- Collaborate
with product managers, data engineers, and designers to align AI
architecture with business goals.
- Manage end-to-end
AI lifecycle — data ingestion, fine-tuning, evaluation, deployment,
and monitoring on Vertex AI / AWS Bedrock / Azure OpenAI.
- Lead scrum
ceremonies, sprint planning, and backlog prioritization for the AI
team.
- Work
directly with external stakeholders and customer teams to
understand requirements, gather feedback, and translate insights into
scalable AI solutions.
- Ensure
compliance with HIPAA, PHI safety, and responsible AI governance
practices.
- Contribute
to hiring, mentoring, and upskilling the AI engineering team.
Requirements
Must-Have Skills
- Deep
expertise in LLMs, RAG, and Agentic AI
architectures, including multi-agent planning and task orchestration.
- Hands-on
experience with LangChain, LangGraph, CrewAI, or Semantic Kernel.
- Strong
proficiency in Python, cloud-native systems, and microservice-based
deployments.
- Proven
track record of leading AI projects from concept to production,
including performance optimization and monitoring.
- Experience
working with healthcare data models (FHIR, HL7, clinical notes) or
similar regulated domains.
- Experience
leading agile/scrum teams, with strong sprint planning and delivery
discipline.
- Excellent
communication and collaboration skills for customer-facing discussions,
technical presentations, and cross-team coordination.
- Deep
understanding of prompt engineering, LLM evaluation, and hallucination
mitigation.
General Skills
- Strong
leadership, mentorship, and people management abilities.
- Excellent
written and verbal communication for both technical and non-technical
audiences.
- Ability
to balance technical depth with product priorities and delivery timelines.
- Adaptability
to fast-changing AI technologies and ability to evaluate new tools
pragmatically.
- A bias
toward ownership and proactive problem-solving in ambiguous situations.
- Empathy
for end-users and a commitment to responsible AI in healthcare.
Good to Have
- Experience
leading AI platform initiatives or building internal AI tooling.
- Exposure
to MLOps, continuous evaluation pipelines, and observability tools
for LLM systems.
- Knowledge
of multi-modal AI (text + structured + image data).
- Prior
experience integrating AI into production SaaS platforms or healthcare
systems.
Benefits
Why Join Fold Health
- Lead the
development of next-generation AI systems transforming healthcare
delivery.
- Collaborate
with world-class data, product, and clinical teams on meaningful
challenges.
- Shape the AI roadmap and mentor a growing team of engineers in an
innovation-first culture.
- Work on cutting-edge
Agentic AI and LLM applications deployed in real-world healthcare
settings.
Similar Jobs
Information Technology
Leads end-to-end development of enterprise AI and LLM applications, including architecture, technical design, Java and Spring Boot backend development, integrations, testing, deployment, and support. Builds generative AI solutions using major LLM providers, prompt engineering, fine-tuning, and agent frameworks. Collaborates with architects and developers to translate designs into scalable microservices, while addressing security, resiliency, databases, containers, Kubernetes, and cloud platforms.
Top Skills:
AnthropicAutogenAWSAzureCrewaiDockerFine-TuningGCPGeminiGenerative AiJavaKubernetesLangchainLanggraphLlm IntegrationsMicroservicesOpenaiOraclePrompt EngineeringPythonSpring Boot
Information Technology
Leads technical planning, requirements gathering, estimation, architecture, development, testing, documentation, deployment, and application support for client projects. Mentors developers, provides technical leadership, collaborates with architects and designers, translates creative designs into functional and technical requirements, and communicates effectively with technical and non-technical stakeholders.
Top Skills:
Agile MethodologiesArtificial IntelligenceJavaLarge Language Models
Information Technology
Lead technical consultant responsible for the full software development lifecycle, including technical design, implementation, testing, deployment, documentation, and support. Builds enterprise AI and LLM applications using OpenAI, Anthropic, Gemini, agent frameworks, Java, Spring Boot, Python, microservices, databases, containers, Kubernetes, and cloud platforms. Collaborates with architects and developers to translate designs into technical solutions while ensuring security, resiliency, and enterprise architecture standards.
Top Skills:
AnthropicAutogenAWSAzureCrewaiDockerFine-TuningGCPGeminiGenerative AiJavaKubernetesLangchainLanggraphLlm IntegrationsMicroservicesOpenaiOraclePrompt EngineeringPythonSpring Boot
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

