llm-ai-security

What this skill does

Tests LLM-powered applications and chatbots against the OWASP AI Security Top 10 (ASI01–ASI10). Covers direct and indirect prompt injection, system prompt leakage, sensitive information disclosure, excessive agency via function calls, output handling flaws (XSS, command injection), vector/embedding weaknesses, unbounded consumption (token exhaustion DoS), and chatbot-specific issues such as conversation IDOR, ASCII smuggling with invisible Unicode, and markdown-based exfiltration channels.

When to use

• When a web application or API exposes an LLM-powered feature (chatbot, copilot, summarizer, code assistant, RAG endpoint)
• During a penetration test or bug bounty engagement that includes AI/LLM components
• When reviewing a new AI feature before production launch
• When a deployed chatbot handles user PII, executes tool calls, or renders markdown to end users

Prerequisites

• curl installed (for API request crafting)
• HTTP proxy (Burp Suite or equivalent) recommended for intercepting LLM API traffic
• Access to the target application with a valid user account
• Knowledge of which LLM provider and model version is in use (if obtainable)
• Written authorization for all testing activities