opik-optimize
Pass
Audited by Gen Agent Trust Hub on Sep 21, 2026
Risk Level: SAFEDYNAMIC_EXECUTIONINDIRECT_PROMPT_INJECTIONEXTERNAL_DOWNLOADSCOMMAND_EXECUTION
Full Analysis
- [DYNAMIC_EXECUTION]: The skill generates a temporary Python script (
.py) outside the repository containing logic to run theopik_optimizer. This script is then executed by the agent to perform the optimization run. - [INDIRECT_PROMPT_INJECTION]: The skill processes external data in the form of datasets (
opik.Dataset) and prompts from the library or codebase. These inputs are used as training/validation data for a reasoning model during optimization, creating an attack surface where malicious data could influence the agent's behavior or the optimization outcome. - Ingestion points: The skill reads datasets via
client.get_datasetand prompts viaclient.get_chat_promptor local fileReadoperations. - Boundary markers: No explicit delimiters or instructions to ignore embedded commands are specified for the ingested data.
- Capability inventory: The skill utilizes
Bashfor script execution,Writefor runner creation, andRead/Grepfor data retrieval. - Sanitization: The instructions do not specify any validation or sanitization steps for the ingested prompt text or dataset items.
- [EXTERNAL_DOWNLOADS]: The skill instructs the agent to install the
opik-optimizerpackage usinguv addorpip install. This is a vendor-owned package associated with Comet ML. - [COMMAND_EXECUTION]: The skill utilizes the
Bashtool to execute the generated Python runner and to install necessary dependencies.
Audit Metadata