Crunchyroll Logo

Crunchyroll

LLM Engineer III

Posted 7 Hours Ago
Be an Early Applicant
Hybrid
Hyderabad, Telangana
Senior level
Hybrid
Hyderabad, Telangana
Senior level
Architect and implement LLM applications, design pipelines, fine-tune models, develop APIs, and monitor LLM systems while collaborating with teams to integrate AI/ML capabilities.
The summary above was generated by AI
About Crunchyroll

Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across 200+ countries and territories, and help them connect with the stories and characters they crave. Whether that experience is online or in-person, streaming video, theatrical, games, merchandise, events and more, it’s powered by the anime content we all love.

Join our team, and help us shape the future of anime!

About the Team

The R&D team is dedicated to developing, testing, and validating robust and scalable machine learning models that drive business objectives. Our focus includes enhancing operational processes through AI/ML solutions, such as trend analysis, anomaly detection, and the deployment of large language models (LLMs) for tasks like querying system health. Another major focus area is preserving, and improving customer experience and retention. We closely work with our stakeholders to ensure AI/ML objectives are clearly defined.

About the role

Crunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The AI/ML team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.

  • Architect and implement end-to-end LLM-based applications, including chatbots, assistants, search agents, and knowledge discovery tools.
  • Design and deploy scalable RAG and GraphRAG pipelines using vector databases (e.g., Opensearch, Pinecone, Mongo) and document chunking strategies.
  • Fine-tune and optimize foundation models (e.g., Bedrock, Claude, Nova) for domain-specific use cases.
  • Own prompt design and evaluation - build prompt libraries and frameworks that enable rapid experimentation and reuse.
  • Develop APIs and microservices to serve LLM-based applications with real-time latency and uptime guarantees.
  • Collaborate with data, platform, and backend teams to integrate LLM capabilities into broader Crunchyroll product experiences.
  • Monitor and evaluate LLM systems in production for hallucination, latency, cost, and feedback loops.
  • Stay up to date with the latest in LLM research, tooling (LangChain, LlamaIndex), and ecosystem advancements.
About You

We get excited about candidates, like you, because...

  • Bachelor's or Master's degree in Computer Science, Machine Learning, AI, or a related field.
  • 5+ years of experience building production ML/AI systems, with 2+ years specifically focused on LLM applications.
  • Hands-on experience with production-ready RAG systems using tools like LangChain, LlamaIndex, or custom pipelines.
  • Hands-on experience with GraphRAG, LLMs, Graph and Vector Databases.
  • Deep understanding of prompt engineering, prompt templating, and prompt evaluation strategies.
  • Experience working with major foundation models (OpenAI, Anthropic, Nova, Bedrock etc.).
  • Familiarity with building semantic search systems and working with vector DBs at scale.
  • Strong backend/API development experience using TypeScript and knowledge of deploying services to cloud environments.
  • Python skills and experience working with AWS cloud platform and MLOps tools (e.g., AWS Bedrock, SageMaker, Databricks, Lambda, ECS/Fargate).
Why you will love working at Crunchyroll

In addition to getting to work with fun, passionate and inspired colleagues, you will also enjoy the following benefits and perks:

  • Best-in class medical, dental, and vision private insurance healthcare coverage
  • Access to counseling & mental health sessions 24/7 through our Employee Assistance Program (EAP)
  • Free premium access to Crunchyroll
  • Professional Development
  • Company's Paid Parental Leave
    • up to 26 weeks for birthing parents
    • up to 12 weeks for non-birthing parents
  • Hybrid Work Schedule
  • Paid Time Off
    • Flex Time Off
    • 5 Yasumi Days
    • Half-Day Fridays June - August
    • Winter Break
About our Values

We want to be everything for someone rather than something for everyone and we do this by living and modeling our values in all that we do. We value

  • Courage. We believe that when we overcome fear, we enable our best selves.

  • Curiosity. We are curious, which is the gateway to empathy, inclusion, and understanding.

  • Kaizen. We have a growth mindset committed to constant forward progress.
  • Service. We serve our community with humility, enabling joy and belonging for others.

Our commitment to diversity and inclusion

Our mission of helping people belong reflects our commitment to diversity & inclusion. It's just the way we do business.

We are an equal opportunity employer and value diversity at Crunchyroll. Pursuant to applicable law, we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Crunchyroll, LLC is an independently operated joint venture between US-based Sony Pictures Entertainment, and Japan's Aniplex, a subsidiary of Sony Music Entertainment (Japan) Inc., both subsidiaries of Tokyo-based Sony Group Corporation.

Questions about Crunchyroll’s hiring process? Please check out our Hiring FAQs: https://help.crunchyroll.com/hc/en-us/articles/360040471712-Crunchyroll-Hiring-FAQs

Please refer to our Candidate Privacy Policy for more information about how we process your personal information, and your data protection rights: https://tbcdn.talentbrew.com/company/22978/v1_0/docs/spe-jobs-privacy-policy-update-for-crpa-dec-21-22.pdf

Please beware of recent scams to online job seekers. Those applying to our job openings will only be contacted directly from @crunchyroll.com email account.

Top Skills

Anthropic
AWS
Bedrock
Databricks
Ecs
Fargate
Lambda
Langchain
Llamaindex
Mongodb
Openai
Opensearch
Pinecone
Python
Sagemaker
Typescript

Similar Jobs at Crunchyroll

7 Hours Ago
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
As a Senior Software Engineer at Crunchyroll, you'll create proof-of-concepts, develop internal tools, and enhance business initiatives using AI technology, leveraging over 8 years of experience in complex systems.
Top Skills: AIExperimental PrototypesFrameworksInternal ToolsLlmRapid PrototypingSoftware Development
7 Hours Ago
Hybrid
Hyderabad, Telangana, IND
Expert/Leader
Expert/Leader
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
As a Principal Software Engineer at Crunchyroll, you will lead innovation efforts, create proof-of-concepts, and mentor teams while supporting key projects with AI-powered features.
Top Skills: AILlm Training Pipelines
11 Hours Ago
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
As a Senior DevOps Engineer, you'll automate and scale systems for Crunchyroll's streaming platform, collaborate with teams on infrastructure automation, and enhance processes for observability, security, and reliability.
Top Skills: AWSAws CloudfrontCi/CdDatadogDynamoDBEcsGithub ActionsGitopsInfrastructure As CodeKubernetesLinuxMongoDBMySQLPostgresPulumiTerraformTypescript

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account