AI Security Wiki GitHub

Home / Reference / AI Security Glossary and Taxonomy

AI Security Glossary and Taxonomy

Purpose: Provide common terminology for AI security governance, engineering, red teaming, assurance, vendor evaluation and audit.

Audience: All wiki users.

Term Definition
AI Usage Governance Controls that discover, monitor and govern how users interact with AI tools.
AI Data Protection Controls that detect and prevent leakage of sensitive data through AI interactions.
AI Runtime Security Controls that protect AI applications during operation.
AI-SPM AI Security Posture Management; inventory, assess and govern AI assets and configurations.
AI Supply Chain Security Protection of models, datasets, libraries, plugins, MCP servers and AI dependencies.
Agentic AI Security Governance of AI agents that can use tools, APIs or workflows.
Prompt Injection Attack that manipulates model instructions or application behavior through crafted input.
Indirect Prompt Injection Prompt injection delivered through external or retrieved content.
RAG Security Security of retrieval-augmented generation systems and their data sources.
Shadow AI Use of AI tools without approval, governance or security visibility.
MCP Model Context Protocol; an emerging mechanism for connecting AI systems to tools and data sources.
Tool Calling AI system invocation of tools, APIs, commands, workflows or plugins.
AI Output Leakage Sensitive information exposed through generated AI responses.
AI Red Teaming Adversarial testing of AI systems to validate resilience and controls.
AI Security The broader discipline of managing security risks associated with AI systems and AI use; the umbrella over security of AI and AI for security.
Security of AI Protection of AI systems and their lifecycle from malicious or accidental compromise.
AI for Security Use of AI to perform or augment defensive security functions.
Adversarial Machine Learning Study and mitigation of attacks that exploit machine-learning behaviour.
Data Poisoning / Model Poisoning Malicious manipulation of training data or model artifacts.
Excessive Agency Unnecessary functionality, permissions or autonomy that enables harmful actions (OWASP LLM06).
Policy Enforcement Point A deterministic component that authorizes or denies an action independently of the model.
Provenance The origin and transformation history of an artifact or data item.
Robustness Resilience under relevant perturbations and unexpected conditions.
Evaluation Systematic measurement against defined criteria.
Model Drift Changes in behaviour or performance over time, including those caused by data, model, configuration or environment.
LLM Large Language Model; a model designed to process and generate language.
SLM Small Language Model; a smaller model optimized for constrained or specialized use cases.
RAG Retrieval-Augmented Generation; a pattern where the AI system retrieves external content to support responses.
Vector Database A system used to store and retrieve embeddings or semantic representations.
Agent AI system capable of planning or acting through tools, APIs or workflows.
Guardrails Controls that constrain or monitor AI inputs, outputs and behavior.
AI BOM AI Bill of Materials; inventory of models, datasets, libraries, plugins and dependencies.
Model Registry Repository for tracking models, versions, metadata and governance status.
AI Assurance Evidence-based validation that AI systems operate securely, reliably and according to policy.

The distinction between AI security, security of AI and AI for security is explained in Terminology and the Two-Axis Model.

Usage Guidance

Use this glossary to standardize language in risk reviews, control descriptions, architecture documents, vendor questionnaires and audit evidence.