Skip to main content

Taxonomies

Taxonomy of Failure Mode in Agentic AI Systems (Microsoft AI Red Team, version 1.0)

Microsoft AI Red Team (AIRT) · v1.0 (2025-04) · first published 2025-04-24

Scope

Version 1.0 of the Microsoft AI Red Team's list of failure modes of agentic AI systems: 27 modes on two axes, safety or security and novel (only in agentic systems) or existing (known from other AI systems, with higher risk in agents). 4 novel safety, 6 novel security, 7 existing safety and 10 existing security modes. The paper calls its method a failure mode and effects analysis of current and envisaged systems. It is about agentic systems in general, with many multi-agent cases, not about coding agents.

Source → License: Microsoft whitepaper; no open licence stated

Why it's ingested

A vendor red team's list of how agentic systems fail, widely cited in security discussions of agents. Several of its modes are close to SAICA failure modes (Excessive agency, Hallucinations, Function compromise and malicious functions, Memory poisoning); most of the rest concern multi-agent attacks and responsible-AI harms that SAICA does not cover. See data/crosswalks/msft-airt-to-saica.yml.

Categories & crosswalks

Each row is one category of this taxonomy with the SAICA failure modes mapped to it and how close each mapping is: “exact” means the same failure, “partial” an overlap, “related” a neighbouring category. 13 mappings cover 11 of the 27 categories; the 16 with no mapping are listed under them. The category ids and labels were last compared with the source on 2026-11-21.

Mapping drafted by an AI model from the source text; not yet reviewed by a person.

Categories with no SAICA failure mode

These 16 categories have no mapping. The reason is the one the crosswalk file states; where it states none, that is said.

Notes

Rebuilt on 2026-11-21 from the whitepaper PDF (28 pages, created 2025-04-16), linked from the blog post in `url`: https://cdn-dynmedia-1.microsoft.com/is/content/microsoftcorp/microsoft/final/en-us/microsoft-brand/documents/Taxonomy-of-Failure-Mode-in-Agentic-AI-Systems-Whitepaper.pdf Labels are those of the table "Overview of failure modes"; for MS-ES-03 the table gives only the acronym XPIA, so the heading of the details section is used. Quoted text is the "Description" line of each mode. The ids are SAICA-KG's, in the order of the table; the whitepaper publishes none. What changed. Until 2026-11-21 this file held 18 of the 27 modes, taken from summaries of the whitepaper, with several labels reworded and one description wrong (Agent injection was described as injected instructions; the paper means injected agents). Nine modes were missing: Agent provisioning poisoning, Targeted knowledge base poisoning, Function compromise and malicious functions, Resource exhaustion, Excessive agency, Loss of data provenance, Parasocial relationships, User impersonation and Insufficient intelligibility for meaningful consent. Ids that moved (old id -> new id): MS-NS-05 Multi-agent jailbreaks -> MS-NS-06; MS-ES-02 XPIA -> MS-ES-03; MS-ES-03 Human-in-the-loop bypass -> MS-ES-04; MS-ES-04 Incorrect permissions -> MS-ES-06; MS-ES-05 Insufficient isolation -> MS-ES-08; MS-EF-01 Bias amplification -> MS-EF-03; MS-EF-02 Hallucinations -> MS-EF-06; MS-EF-03 Misinterpretation of instructions -> MS-EF-07; MS-EF-04 (was "Lack of Transparency") -> MS-EF-01. An old reference by id must be re-read. The same completion was first made on 2026-08-17 (commit 07cbe15) and was lost in the reset of 2026-11-19. Version 2.0 exists (PDF "Taxonomy of Failure Modes in Agentic AI Systems, v2.0", dated April 2026, read on 2026-11-21). It keeps these 27 modes and adds seven novel security modes: Agentic supply chain compromise, Goal hijacking, Inter-agent trust escalation, Computer Use Agent (CUA) visual attack, Session context contamination, MCP/plugin abuse and Capability/architecture disclosure. They are not in this file; adding version 2.0 as its own taxonomy node is an open decision.

View raw YAML on GitHub →