LLM / SLM Full‑Stack Developer

About Us

Hitachi Digital builds secure, scalable AI applications for global OpCos, with a focus on Agentic AI and enterprise governance. We leverage GCP services (Vertex AI, Agent Workspace), robust data foundations, and model guardrails to deliver business outcomes at scale.

Role Overview

We’re seeking a LLM Full‑Stack Developer who can design, build, and operate production AI applications that combine front‑end product craftsmanship with backend/LLMOps rigor. You will implement ensemble strategies across LLMs and SLMs (small language models), develop Agentic AI workflows, and integrate RAG, evaluation, and guardrails into full‑stack experiences. Gemini Enterprise experience is nice to have; strong GCP/Vertex AI skills are expected.

Key Responsibilities

• Product & Front-End
• Build responsive, accessible web UIs for AI features (chat, copilot sidebars, inline recommendations).
• Implement human-in-the-loop UX and telemetry hooks.
• Backend, LLM Integration & RAG
• Implement ensemble LLM/SLM pipelines with fallback/guarded execution.
• Build RAG flows: ingestion, embeddings, vector search, grounding, attribution.
• Expose secure APIs and integrate with enterprise systems.
• Agentic AI & Orchestration
• Design multi-agent workflows with tool-use policies and memory strategies.
• Use Vertex AI Agent Builder/Workspace for orchestration.
• Quality, Safety & Observability
• Instrument LLMOps evaluation harnesses, monitoring, red-teaming.
• Implement guardrails, explainability, and audit logs.
• Performance & Cost
• Optimize prompts, retrieval, caching, batching, autoscaling.

Required Qualifications

• Bachelor’s/Master’s in CS, AI/ML, or related field.
• 6+ years full-stack development; 3+ years building LLM applications.
• Experience with ensemble LLM/SLM approaches.
• Hands-on with Agentic AI patterns.
• Strong GCP/Vertex AI skills.
• Proficiency in Python and TypeScript/Node.js.
• Expertise with vector DBs, embeddings, RAG.
• UI experience with React or similar.

Preferred Qualifications

• Experience with Gemini Enterprise / Agent Workspace.
• Familiarity with LangChain/Graph and knowledge graphs.
• Exposure to SLM distillation/fine-tuning.
• Google Cloud certifications.

Key Competencies

• Product mindset with strong UX quality bar.
• Systems thinking across data/models/agents.
• Security & compliance awareness.
• Strong communication across global teams.

Success Metrics (first 6–12 months)

• Launch 2+ LLM features with measurable impact.
• Achieve >20–30% response quality or latency improvements.
• Establish evaluation dashboards and telemetry.
• Document guardrails and explainability to governance standards.

What You’ll Work With

• GCP: Vertex AI, Agent Builder/Workspace, Vector Search, Cloud Run/GKE, IAM.
• Vector DBs, embeddings, RAG, optional knowledge graphs.
• Python, Node.js/TypeScript, React, CI/CD, observability tools.

Fostering innovation through diverse perspectives

Hitachi is a global company operating across a wide range of industries and regions. One of the things that sets Hitachi apart is the diversity of our business and people, which drives our innovation and growth.

We are committed to building an inclusive culture based on mutual respect and merit-based systems. We believe that when people feel valued, heard, and safe to express themselves, they do their best work.

How we look after you

We help take care of your today and tomorrow with industry-leading benefits, support, and services that look after your holistic health and wellbeing. We’re also champions of life balance and offer flexible arrangements that work for you (role and location dependent). We’re always looking for new ways of working that bring out our best, which leads to unexpected ideas. So here, you’ll experience a sense of belonging, and discover autonomy, freedom, and ownership as you work alongside talented people you enjoy sharing knowledge with.

We’re proud to say we’re an equal opportunity employer and welcome all applicants for employment without attention to race, colour, religion, sex, sexual orientation, gender identity, national origin, veteran, age, disability status or any other protected characteristic. Should you need reasonable accommodations during the recruitment process, please let us know so that we can do our best to set you up for success.