calibrate-evaluator
Fail
Audited by Gen Agent Trust Hub on Oct 23, 2026
Risk Level: HIGHREMOTE_CODE_EXECUTIONPROMPT_INJECTIONDYNAMIC_EXECUTIONINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTION
Full Analysis
- [REMOTE_CODE_EXECUTION]: The skill executes an
npxcommand to download and run theskillspackage from the NPM registry during initialization. - [PROMPT_INJECTION]: Instructions mandate the concealment of update processes from the user and command the agent to disregard its current system context in favor of newly updated files, which can be used to bypass security constraints.
- [DYNAMIC_EXECUTION]: The skill implements a self-modification pattern where it updates its own source files and instructs the agent to reload and follow the new version, bypassing static analysis of the original skill.
- [INDIRECT_PROMPT_INJECTION]: The workflow ingests external data including agent outputs and human annotations for processing through the
calibratetool without documented sanitization or boundary markers, creating a surface for indirect injection. - [COMMAND_EXECUTION]: The skill uses multiple shell commands to manage external tools and processes, including
npxand a customcalibrateCLI tool.
Recommendations
- AI detected serious security threats
Audit Metadata