evaluate-plugin

Installation
SKILL.md

Evaluate Plugin

Use this skill when the target is a plugin root with .codex-plugin/plugin.json.

Workflow

  1. Treat "Evaluate this plugin." as the default entrypoint.
  2. If the request comes in as natural chat language, use plugin-eval start <plugin-root> --request "<user request>" --format markdown first so the user sees the routed local path.
  3. Run plugin-eval analyze <plugin-root> --format markdown.
  4. Read Fix First before drilling into manifest findings, nested skill findings, and code or coverage details.
  5. If the plugin contains multiple skills, summarize the strongest and weakest ones explicitly.
  6. If the user wants measured usage, switch to "Help me benchmark this plugin." and use the starter benchmark flow.
  7. If the user wants trend data, compare two JSON outputs with plugin-eval compare.

Chat Requests To Recognize

Installs
1
Repository
openai/plugins
GitHub Stars
7.0K
First Seen
Aug 17, 2026
evaluate-plugin — openai/plugins