Lead design and evolution of AI agent architecture (Master Agent + domain agents) across Copilot Studio, Azure and multicloud. Define integrations, knowledge layers, conversational UX, LLMOps, security, performance, and quality metrics. Collaborate with DevOps, Security, AI/ML engineers and domain owners to implement standards, compliance, monitoring, and continuous improvement for enterprise knowledge management.
CAPCO POLAND
Architect AI
Location: Warsaw, Poland
Pref. work model - 3x per week from office
At Capco Poland, we’re not just another consultancy - we’re the spark behind digital transformation in the financial world. As a global leader in technology and management consulting, we thrive on helping clients tackle the toughest challenges across banking, payments, capital markets, wealth, and asset management.
Our secret?
A culture that’s fast, flexible, and fiercely entrepreneurial. We move quickly, think creatively, and always put our people first.
We’re passionate about growth - both for our clients and ourselves - and that means attracting the very best talent to join us on this exciting journey.
We’re proud to be:
• Trailblazers in banking, payments, capital markets, wealth, and asset management
• Champions of an agile, nimble, and innovative work environment
• Dedicated to building a team of top-notch professionals who share our drive and vision
• Trailblazers in banking, payments, capital markets, wealth, and asset management
• Champions of an agile, nimble, and innovative work environment
• Dedicated to building a team of top-notch professionals who share our drive and vision
ROLE OVERVIEW
We are looking for AI Architect that leads the design and evolution of AI agent architecture within the Master Agent Knowledge Management ecosystem and domain-specific agents. The role ensures secure, scalable, and well-integrated solutions that enable consistent knowledge flow and high-quality agent performance. By combining technical expertise with architectural and product thinking, the AI Architect drives the stability, compliance, and continuous improvement of the AI agent platform in line with business needs.
Fluency in Polish is mandatory.
RESPONSIBILITIES
- Designing AI agent architecture (Master Agent + domain agents) in Copilot Studio, Azure, and multicloud integrations (Azure/GCP).
- Modeling agent workflows: orchestration, task delegation, context handling, agent registry, and profiling instructions.
- Designing and implementing integrations: REST/APIs, MCP, custom tools, custom connectors, and Graph Connectors.
- Designing and maintaining knowledge layers: Azure AI Search / Knowledge Bases, indexes, metadata, RAG policies, and cataloging standards (SharePoint Online).
- Designing and overseeing conversational UX: prompt engineering, intent design, dialog flows, and context interpretation.
- Defining agent quality metrics: factuality, relevance, compliance, hallucination rate, coverage, latency, and response cost.
- Designing and implementing LLMOps: automated evaluations, test pipelines, monitoring, observability, and alerting.
- Managing security: PII compliance, anonymization/masking, access control (Entra ID), and document/segment-level authorization.
- Optimizing performance: latency, token usage, caching, vector policies, and inference cost per query.
- Coordinating integrations with other agents and platforms (Power Platform, Foundry AI, GCP BigQuery/Looker, Vertex AI, Document Intelligence).
- Defining architecture standards and integration patterns for the entire Knowledge Management program.
- Collaborating with DevOps, Security, AI/ML Engineers, and domain owners to ensure compliance with implementation standards.
SKILLS & EXPERIENCES TO GET THE JOB DONE
- Very good knowledge of Azure OpenAI / Azure AI Foundry and Azure AI Search / Knowledge Bases.
- Hands-on experience with Copilot Studio (agents, prompt flows, tools, integrations).
- Strong knowledge of Azure, Log Analytics, and observability practices for AI agents.
- Understanding of Entra ID: permissions, OAuth2, authorization flows, and document/index-level access control.
- Experience with GitHub Actions, Azure Container Registry (ACR), and CI/CD pipelines.
- Ability to design event-driven architectures (Service Bus, Event Grid, Durable Functions).
- Experience with REST/API integrations, webhooks, Graph API, and MCP.
- Knowledge of integration patterns in agent-based architecture and multicloud environments (Azure ↔ GCP).
- Practical experience with LLMOps: quality evaluations, regression testing, and guardrails.
- Good understanding of RAG principles, metadata processing, and indexing policies.
- Strong knowledge of data security, including PII masking and regulatory compliance.
- Ability to design AI agents in multi-agent ecosystems (Master Agent + agent-to-agent communication).
Nice to have:
- Experience with Microsoft Fabric / Fabric AI (Lakehouse, OneLake, semantic models).
- Experience with Graph Connectors (M365, SharePoint, Teams).
- Experience with Azure Document Intelligence / OCR.
- Python skills (LLM pipelines, automated testing).
- Docker, AKS, and Azure Container Apps (ACA).
- Durable Functions and Logic Apps.
- Integrations with Microsoft Graph (mailbox, Teams, ChatOps).
IMPORTANT
- Fluent Polish (spoken and written) – mandatory
- Good command of English for documentation and collaboration.
- Availability to work on-site, with partial remote work - 3 days per week from the office.
ONLINE RECRUITMENT PROCESS STEPS
- Screening call with the Recruiter
- Hiring Manager Technical Interview
- Client stage
- Feedback/Offer
We offer a flexible collaboration model based on a B2B contract, with the opportunity to work on diverse projects.
Top Skills
Azure Openai,Azure Ai Foundry,Azure Ai Search,Knowledge Bases,Copilot Studio,Azure,Google Cloud Platform (Gcp),Rest Api,Mcp,Graph Connectors,Sharepoint Online,Entra Id,Github Actions,Azure Container Registry (Acr),Ci/Cd,Service Bus,Event Grid,Durable Functions,Webhooks,Microsoft Graph Api,Power Platform,Foundry Ai,Bigquery,Looker,Vertex Ai,Azure Document Intelligence,Ocr,Llmops,Rag,Log Analytics,Observability,Microsoft Fabric,Onelake,Semantic Models,Python,Docker,Aks,Azure Container Apps (Aca),Logic Apps,Microsoft Teams,Chatops
Similar Jobs at Capco
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Analyzing financial adjustments for regulatory reporting, focusing on Counterparty Credit Risk and Liquidity. Collaborating with Product Controllers to improve data quality and processes for reporting.
Top Skills:
Data QualityProduct ControlRegulatory Reporting
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
QA / AI QA Tester responsible for designing test suites and evaluation datasets for LLM/agent systems, performing response quality, PII/compliance, guardrail, performance, integration and UX testing, analyzing telemetry, documenting results, and supporting AI/domain teams on defects and data drift.
Top Skills:
Copilot Studio,Azure Ai Search,Azure Openai,Foundry,Document Intelligence,Sharepoint Online,Application Insights,Log Analytics,Python,Pandas,Requests,Rest Apis,Github Actions,Bigquery,Looker,Ocr
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design and implement document ingestion pipelines, processing workflows, normalization, indexing into Azure AI Search, automated evaluation and monitoring, CI/CD and containerized services, and ensure security/compliance for knowledge artifacts.
Top Skills:
Python,Asyncio,Fastapi,Pydantic,Multiprocessing,Azure Sdk For Python,Azure Storage,Azure Cognitive Services,Azure Ai Search,Azure Document Intelligence,Microsoft Graph Api,Sharepoint Api,Application Insights,Log Analytics,Pytest,Github Actions,Docker,Azure Container Registry,Azure Container Apps,Aks,Web App For Containers,Azure Functions,Logic Apps,Durable Functions,Entra Id (Azure Ad),Vector Search,Embeddings
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
