MetLife logo, now hiring for IT positions
MetLife Logo

MetLife

Software Platform Engineer II

Posted 24 Days Ago
Hybrid
Pune, Maharashtra, IND
Entry level
Hybrid
Pune, Maharashtra, IND
Entry level
Design, build, and operate production AI services, agentic workflows, and LLM-powered features. Responsibilities include developing Python APIs and microservices, implementing RAG and vector search, optimizing model inference, integrating event-driven systems, deploying services on Docker and Kubernetes, monitoring reliability, managing CI/CD and testing, and partnering with frontend teams to deliver end-to-end AI products.
The summary above was generated by AI
Description and Requirements
Job Summary
We are seeking a highly skilled Senior AI Backend Engineer to design, build, and productionize backend systems and ML/LLM inference pipelines within cloud-native environments. This role focuses on developing and operating production-grade AI agents powered by frontier models while ensuring scalability, reliability, and operational excellence.The ideal candidate will have strong expertise in backend engineering, model serving, and AI platform development, with hands-on experience in Agentic AI frameworks such as LangGraph and LangChain. You will be responsible for building the orchestration layer around large language models, including tooling, context management, workflow automation, guardrails, and evaluation frameworks.Experience with Azure cloud services, Azure Kubernetes Service (AKS), and cloud-native operations is highly desirable.
Key Responsibilities:
AI & Backend Engineering:
  • Design, develop, and maintain scalable backend APIs and microservices using Python, FastAPI, and asynchronous programming patterns.
  • Build and deploy production-ready Agentic AI workflows using LangGraph and LangChain.
  • Develop intelligent agent systems incorporating tool calling, multi-step reasoning, context and memory management, retries, guardrails, and orchestration logic.
  • Operate and optimize production AI agents leveraging frontier models such as GPT, Claude, and Gemini, ensuring optimal performance, cost efficiency, and reliability.
  • Implement advanced LLM capabilities including Retrieval-Augmented Generation (RAG), vector search, embeddings, prompt engineering, and context management.


Model Engineering & MLOps:
  • Package, version, deploy, and monitor ML/LLM models for low-latency, batch, and asynchronous inference workloads.
  • Optimize model serving infrastructure using frameworks such as MLflow, LangSmith, or equivalent platforms.
  • Implement model monitoring, evaluation pipelines, and performance benchmarking processes.


Event-Driven Architecture & Integrations:
  • Build resilient event-driven systems utilizing Kafka, Azure Event Hubs, or similar messaging platforms.
  • Develop idempotent consumers, replay mechanisms, and backfill strategies to ensure data consistency and reliability.
  • Design scalable integration frameworks connecting AI services with enterprise systems.


Cloud & Platform Engineering:
  • Containerize applications using Docker and deploy workloads on Kubernetes environments, including Azure Kubernetes Service (AKS).
  • Create and manage Kubernetes manifests, Helm charts, and deployment configurations.
  • Troubleshoot and optimize containerized workloads, health checks, autoscaling, and resource utilization.


Reliability & Operational Excellence:
  • Implement observability solutions including logging, monitoring, metrics, and distributed tracing.
  • Define and track Service Level Objectives (SLOs) and Service Level Indicators (SLIs).
  • Lead incident response, root-cause analysis, and remediation efforts.
  • Ensure secure, scalable, and highly available AI platform operations.


DevOps & Quality Engineering:
  • Develop automated testing frameworks, CI/CD pipelines, and release automation processes.
  • Collaborate with security and platform teams to implement code quality controls and security scanning.
  • Promote engineering best practices, test-driven development, and operational excellence.


Cross-Functional Collaboration:
  • Work closely with frontend engineering teams using React, Next.js, and TypeScript to deliver end-to-end AI solutions.
  • Collaborate with product, data science, and platform engineering teams to deliver scalable AI capabilities.


Required Qualifications:
Technical Skills:
  • Strong proficiency in Python and modern backend frameworks, preferably FastAPI.
  • Hands-on experience building and operating production AI agents using frontier large language models.
  • Expertise in Agentic AI orchestration, including workflow management, tool execution, memory systems, context handling, and guardrails.
  • Strong experience with LangGraph and/or LangChain frameworks.
  • Deep understanding of model serving, inference optimization, serialization, batching, and monitoring.
  • Experience with vector databases and embedding technologies such as FAISS, Milvus, Pinecone, or similar platforms.
  • Knowledge of Retrieval-Augmented Generation (RAG) architectures and implementation patterns.
  • Strong foundation in distributed systems, concurrency, caching, rate limiting, and reliability engineering.
  • Experience with Docker and Kubernetes administration, deployment, and troubleshooting.
  • Proficiency with CI/CD tools such as Azure DevOps and GitHub Actions.
  • Experience working with data pipelines, feature engineering, and data quality management practices.
  • Working knowledge of React and JavaScript/TypeScript for effective collaboration with frontend teams.
  • Excellent communication skills and strong written English.


Cloud & Infrastructure Requirements:
  • Hands-on experience with Microsoft Azure services and Azure Kubernetes Service (AKS).
  • Experience with Azure DevOps and cloud-native deployment practices.
  • Familiarity with Redis, Cosmos DB, Azure Container Registry (ACR), and similar managed services.


Preferred Qualifications:
  • Experience with Model Context Protocol (MCP) and AI tool/server integrations.
  • Knowledge of load testing, performance tuning, and scalability optimization.
  • Experience with model drift detection, explainability tools, MLflow Registry, or LangSmith.
  • Exposure to multi-agent architectures, fine-tuning techniques, and structured output generation.
  • Infrastructure as Code (IaC) experience using Terraform, Bicep, or equivalent technologies.

About MetLife
Recognized on Fortune magazine's list of the "World's Most Admired Companies" and Fortune World's 25 Best Workplaces™, MetLife, through its subsidiaries and affiliates, is one of the world's leading financial services companies; providing insurance, annuities, employee benefits and asset management to individual and institutional customers. With operations in more than 40 markets, we hold leading positions in the United States, Latin America, Asia, Europe, and the Middle East.
As part of our New Frontier strategy, MetLife is building an AI-enabled, people-centered future. We're looking for people who bring curiosity, adaptability, and a growth mindset as we use AI to enhance how we serve customers, support communities, and evolve the way work gets done. At MetLife, AI is a responsible partner that supports human judgment, creativity, and continuous improvement while helping us build trust, inclusion, and long-term value.
Our purpose is simple - to help our colleagues, customers, communities, and the world at large create a more confident future. United by purpose and guided by our core values - Win Together, Do the Right Thing, Deliver Impact Over Activity, and Think Ahead - we're inspired to transform the next century in financial services. At MetLife, it's #AllTogetherPossible . Join us!
#BI-Hybrid

MetLife Pimpri-Chinchwad, Maharashtra, IND Office

MetLife Pune, IN Office

EON West LP-II, 2nd & 3rd Floor, Tower D, S.no. 106(P), 107(P), 108(P)/1, Pimpri-Chinchwad, Maharashtra, India, 411057

Similar Jobs at MetLife

10 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Architects, develops, and deploys enterprise generative AI and agent-based solutions using LLMs, retrieval pipelines, Microsoft agent technologies, Azure services, Python, and C#/.NET. Owns platform architecture, infrastructure as code, CI/CD, observability, governance, optimization, and roadmap advancement. Leads solution design, stakeholder collaboration, code reviews, mentoring, and post-deployment improvements for employee-facing AI applications.
Top Skills: Adaptive CardsAzure Ai Agent ServicesAzure Ai FoundryAzure Ai SearchAzure Api ManagementAzure FunctionsAzure OpenaiC#/.NetCi/CdClaudeFaissGptHugging Face TransformersLangchainLanggraphLlamaLlamaindexMcpMicrosoft 365 Agent SdkMicrosoft Agent FrameworkAzureMicrosoft TeamsPineconePythonRest ApisSemantic KernelTerraform
15 Days Ago
Hybrid
Pune, Maharashtra, IND
Entry level
Entry level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Build and deliver scalable, cloud-native, API-driven applications using React, Node.js, Next.js, Azure, REST APIs, and microservices. Develop accessible, high-performance interfaces, implement CI/CD pipelines, apply DevSecOps and automated testing practices, troubleshoot production issues, and collaborate with cross-functional teams to deliver reliable software solutions.
Top Skills: AzureCi/CdDevsecopsGithub CopilotMicroservicesNext.JsNode.jsReactRest Apis
4 Days Ago
Hybrid
Pune, Maharashtra, IND
Senior level
Senior level
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Designs and maintains CI/CD pipelines for data, analytics, and machine learning workloads across on-premise and Azure environments. Manages containerized infrastructure using Docker and Kubernetes, implements monitoring and observability, embeds security practices, and optimizes deployment reliability and scalability. The role also mentors MLOps engineers, documents operational standards, leads solution design and estimations, and collaborates with business, technology, operations, and data teams.
Top Skills: SparkAzure AppsAzure CliAzure DevopsAzure Key VaultAzure Kubernetes Service (Aks)Azure Machine LearningAzure SynapseBashCmdCyberarkDatabricksDockerHadoopHTTPJdbcKubernetesLdapMlflowPostmanPowershellPythonRbacRest ApisSQLSslToscaXMLYaml

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account