llm-obs-experiment-analyzer
Pass
Audited by Gen Agent Trust Hub on Jun 12, 2026
Risk Level: SAFEPROMPT_INJECTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADS
Full Analysis
- [PROMPT_INJECTION]: The skill is susceptible to indirect prompt injection because it processes untrusted data from LLM experiment events (inputs, outputs, and metadata) fetched via Datadog APIs. A malicious experiment record could contain instructions designed to manipulate the agent's analysis or output. The skill lacks explicit boundary markers or sanitization logic for this ingested content, although it does instruct the agent to mask PII.\n
- Ingestion points:
list_llmobs_experiment_eventsandget_llmobs_experiment_eventtool calls inSKILL.md.\n - Capability inventory: File system writing, shell command execution via the
pupCLI, and Datadog notebook creation.\n - Boundary markers: Not specified in the workflow instructions.\n
- Sanitization: Instructions are limited to PII masking and do not cover adversarial input filtering.\n- [COMMAND_EXECUTION]: The skill instructs the agent to execute shell commands using the
pupCLI tool for its data processing backend. While experiment IDs are validated as UUIDs, other parameters such as metric labels or dimension values are derived from the experiment data itself. If these values contain shell metacharacters and the agent invokes the CLI via a shell without proper escaping, it could lead to command injection. Note that the data source is the user's own Datadog infrastructure.\n- [EXTERNAL_DOWNLOADS]: The skill provides instructions for the user to add an MCP server fromhttps://mcp.datadoghq.com. This domain is the official platform for the trusted vendor and author (Datadog), and the reference is part of the intended setup process.
Audit Metadata