LLM Risk Assessment (2025)

Comprehensive evaluation of LLM applications against OWASP Top 10 for LLM Applications 2025. Follow the detailed procedure in plays/llm-risk-assess.md.

Steps

1. Architecture & Threat Modeling

   • Map LLM provider (OpenAI, Anthropic, local models)
   • Document data flows: user input → preprocessing → prompt construction → LLM → output processing → actions
   • Identify RAG components, tool integrations, memory systems
   • Define trust boundaries and attack surfaces

2. Automated Security Testing

   • Run prompt injection probes (Garak, Giskard, custom scripts)
   • Test output handling vulnerabilities
   • Scan for secrets in prompts and configurations
   • Validate vector database security