dentsu Logo

dentsu

Multi Modal AI Senior Developer

Posted 7 Days Ago
Be an Early Applicant
2 Locations
Senior level
2 Locations
Senior level
The Multi Modal AI Senior Developer will build innovative Generative AI solutions across multiple content types, leveraging various AI models, cloud integration, and full-stack development skills to support enterprise products.
The summary above was generated by AI

We are seeking a seasoned and experienced Multi Modal AI Senior Developer with a deep expertise in leveraging Generative AI for creative and content generation at scale.
The ideal candidate would have a deep understanding of Multi Modal AI, the ability to leverage Gen-AI models for all creative output and content types, and the ability to work across all content and interaction modalities – including text, visuals, audio/speech and video. A strong foundation in Large Language models and Vision Language Models (VLM) is also highly desirable.
As a Multi Modal AI Senior Developer, you will play a key role in building cutting-edge products and innovative solutions, combining the full power of Creative AI workflows, Generative AI, LLMs, and Agentic AI.
Your primary focus will be on building bespoke products and creative workflows leveraging Gen-AI models to help build out our creative product portfolio for some of our largest, most strategic enterprise product solutions.
The candidate should have a good technical background in Product Development, Cloud-Native App Dev, Front-End and Back-End Web Application Development, and the ability to build these solutions in cloud environments such as Azure and AWS, integrating with the appropriate multi modal AI services.
The candidate will also need to have strong expertise with Cloud AI services such as Azure OpenAI, AWS Bedrock, and Google Gemini, and all the foundation models hosted within those services. Additionally, hands-on experience with a variety of foundation models, Vision Language Models (VLMs), Creative AI Services and APIs, and the ability to seamlessly integrate all of these together, in an automated workflow using APIs and AI Assistants, will be an essential skillset.

Job Description:

Key Skills required :

Generative AI, Multi Modal AI

Creative AI solutions and workflows across all creative content types including Copy/Text, Imagery, Key Visuals, Characters, Avatars, Audio, Speech and Video AI

Creative AI Automation workflows with content creation and content editing at scale, using AI services and AI APIs

Experience with multiple Multi Modal AI Foundation Models

LLM, LLM App Dev

AI Agents, Agentic AI Workflows

Responsibilities:

  • Design and build web apps and solutions that leverage Creative AI Services, Multi Modal AI models, and Generative AI workflows
  • Leverage Multi modal AI capabilities supporting all content types and modalities, including text, imagery, audio, speech and video
  • Build creative automation workflows that help produce creative concepts, creative production deliverables, and integrated creative outputs, leveraging AI and Gen-AI models
  • Integrate AI Image Gen Models and AI Image Editing models from key technology partners
  • Integrate Text / Copy Gen Models for key LLM providers
  • Integrate Speech / Audio Gen and Editing models for use cases such as transcription, translation, and AI generated audio narration
  • Integrate AI enabled Video Gen and Video Editing models
  • Fine-Tune Multi Modal AI models for brand specific usage and branded content generation
  • Constantly Research and explore emerging trends and techniques in the field of generative AI and LLMs to stay at the forefront of innovation.
  • Drive product development and delivery within tight timelines
  • Collaborate with full-stack developers, engineers, and quality engineers, to develop and integrate solutions into existing enterprise products.
  • Collaborate with technology leaders and cross-functional teams to develop and validate client requirements and rapidly translate them into working solutions.
  • Develop, implement and optimize scalable AI-enabled products
  • Integrate Gen-AI and Multi Modal AI solutions into Cloud Platforms, Cloud Native Apps, and custom Web Apps
  • Execute implementation  across all layers of the application stack – including front-end, back-end, APIs, data and AI services
  • Build enterprise products and full-stack applications on the MERN + Python stack, with a clear separation of concerns across layers

Skills and Competencies:

  • Deep Hands-on Experience in Multi modal AI models and tools.
  • Hands-on Experience in API integration with AI services
  • Multi Modal AI – competencies :
    • Hands-on Experience with intelligent document processing and document indexing + document content extraction and querying, using multi modal AI Models
    • Hands-on Experience with using Multi modal AI models and solutions for Imagery and Visual Creative – including text-to-image, image-to-image, image composition, image variations, etc.
    • Hands-on Experience with popular AI Image Composition and Editing models from providers such as Adobe Firefly, Getty Images, ShutterStock, Flux and Flux Pro, and Stable Diffusion, and the ability to integrate them programmatically over API calls and workflows
    • Hands-on Experience with Computer Vision and Image Processing using Multi-modal AI – for use cases such as object detection, automated captioning, automated masking, and image segmentation – again all done programmatically over API calls and Workflows
    • Hands-on Experience with using Multi modal AI for Speech – including Text to Speech, Speech to Text, and use of Pre-built vs. Custom Voices
    • Hands-on Experience with building Voice-enabled and Voice-activated experiences, using Speech AI and Voice AI solutions
    • Hands-on Experience with AI Character and AI Avatar development, using a variety of different tools and platforms
    • Fine-Tuning Creative AI Content models for Custom Styles, Custom Characters, and Custom Brand specific imagery
    • Fine-Tuning Speech Models for Custom Voices
    • Good understanding of advanced fine-tuning techniques such as LoRA
    • Ability to execute and run fine-tuning workflows, end-to-end, in particular for Image Gen and Image Editing models
    • Hands-on Experience with leveraging APIs to orchestrate across Multi Modal AI models
    • Hands-on Experience with building workflows that orchestrate across Multi Modal AI models
    • Good Experience with using AI Assistants to drive natural language interactions and orchestration with Multi Modal AI models
    • Good Experience with use of AI Agents and Agentic AI workflows to drive dynamic orchestration across Multi Modal AI services and models
  • Programming Skills :
    • Good Expertise in MERN stack (JavaScript) including client-side and server-side JavaScript
    • Good Expertise in Python based development, including Python App Dev for Multi Modal AI Integration
    • Well-rounded in both programming languages
    • Strong experience in client-side JavaScript Apps and building Static Web Apps + Dynamic Web Apps both in JavaScript
    • Hands-on Experience in front-end and back-end development
    • Minimum 2+ years hands-on experience in working with Full-Stack MERN apps, using both client-side and server-side JavaScript
    • Minimum 2 years hands-on experience in Python development
    • Minimum 2 years hands-on experience in working with LLMs and LLM models, using Python
  • LLM Dev Skills :
    • Solid Hands-on Experience with building end-to-end RAG pipelines and custom AI indexing solutions to ground LLMs and enhance LLM output
    • Good Experience with building AI and LLM enabled Workflows
    • Hands-on Experience integrating LLMs with external tools such as Web Search
    • Ability to leverage advanced concepts such as tool calling and function calling, with LLM models
    • Hands-on Experience with Conversational AI solutions and chat-driven experiences
    • Experience with multiple LLMs and models – primarily GPT-4o, GPT o1, and o3 mini, and preferably also Gemini, Claude Sonnet, etc.
    • Experience and Expertise in Cloud Gen-AI platforms, services, and APIs, primarily Azure OpenAI, and perferably also AWS Bedrock, and/or GCP Vertex AI.
    • Hands-on Experience with Assistants and the use of Assistants in orchestrating with LLMs
    • Hands-on Experience working with AI Agents and Agent Services.

Nice-to-Have capabilities (Not essential) :

  • Hands-on Experience with building Agentic AI workflows that enable iterative improvement of output
  • Hands-on experience with both Single-Agent and Multi-Agent Orchestration solutions and frameworks
  • Hands-on experience with different Agent communication and chaining patterns
  • Ability to leverage LLMs for Reasoning and Planning workflows, that enable higher order “goals” and automated orchestration across multiple apps and tools
  • Ability to leverage Graph Databases and “Knowledge Graphs” as an alternate method / replacement of Vector Databases, for enabling more relevant semantic querying and outputs via LLM models.
  • Good Background with Machine Learning solutions
  • Good foundational understanding of Transformer Models
  • Good foundational understanding of Diffusion Models
  • Some Experience with custom ML model development and deployment is desirable.
  • Proficiency in deep learning frameworks such as PyTorch, or Keras. 
  • Experience with Cloud ML Platforms such as Azure ML Service, AWS Sage maker, and NVidia AI Foundry.

Location:

DGS India - Pune - Kharadi EON Free Zone

Brand:

Dentsu Creative

Time Type:

Full time

Contract Type:

Permanent

Top Skills

Api Integration
Aws Bedrock
Azure Openai
Creative Ai
Foundation Models
Generative Ai
Google Gemini
JavaScript
Mern Stack
Multi Modal Ai
Python

Similar Jobs

5 Days Ago
2 Locations
Senior level
Senior level
AdTech • Marketing Tech
We are looking for a Senior Developer skilled in Multi Modal AI and Generative AI to create innovative solutions and products, utilizing AI workflows that integrate various modalities including text, visuals, audio, and video. Responsibilities include building scalable AI-enabled products, collaborating with teams, and fine-tuning models for creative outputs.
Top Skills: Ai ServicesAPIsAWSAws BedrockAzureAzure OpenaiCloud-Native AppsGenerative AiGoogle GeminiLlmsMern StackMulti Modal AiPythonVision Language Models
6 Hours Ago
2 Locations
Senior level
Senior level
Fintech • Financial Services
Lead and manage an engineering team focused on API and Identity Infrastructure, enhancing the Aladdin platform's security and scalability. Drive modern engineering practices and collaborate with product managers to implement the technical roadmap.
Top Skills: AngularAzure AdBasic AuthenticationCertificate-Based AuthenticationGoGrpcJavaKeycloakMutual TlsOauth 2.0OktaOpenid ConnectPythonTransport Layer Security
7 Hours Ago
Gurugram, Haryana, IND
Senior level
Senior level
Food • Retail • Agriculture • Manufacturing
The S/4 Quality Management Functional Engineer will implement and support SAP QM solutions, translate business requirements, and manage full project lifecycles while coordinating with global teams.
Top Skills: AbapS/4 HanaSAP

What you need to know about the Pune Tech Scene

Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account