replay-compare
Warn
Audited by Gen Agent Trust Hub on Oct 16, 2026
Risk Level: MEDIUMDATA_EXFILTRATIONDYNAMIC_EXECUTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
- [DATA_EXFILTRATION]: The skill accesses historical agent session logs located at
~/.pi/agent/sessions/**/*.jsonl. These logs contain a record of all past interactions, which may include sensitive user data, private information, or credentials. The skill extracts this data and sends it to external backend providers during the replay phase.\n- [DYNAMIC_EXECUTION]: The workflow involves generating a TypeScript file (replay.mts) from a provided template and executing it at runtime. This dynamically created script can perform arbitrary file system and network operations.\n- [COMMAND_EXECUTION]: The replay runner template uses Node.jsexecFileSyncto call external CLI tools. This allows for the execution of arbitrary system commands defined during the script's creation to simulate backend behavior.\n- [EXTERNAL_DOWNLOADS]: The skill's environment check and execution steps rely onnpxto run thetsxpackage. If the package is not already cached, it is downloaded from the npm registry at runtime.\n- [INDIRECT_PROMPT_INJECTION]: The skill ingests and replays historical user queries. If those queries contained malicious instructions or were designed to trigger specific agent behaviors, they would be re-processed by the tools under test.\n - Ingestion points: Historical logs at
~/.pi/agent/sessions/**/*.jsonlprocessed byscripts/extract-queries.py.\n - Boundary markers: None; extracted queries are passed directly to tools without delimiters or safety warnings.\n
- Capability inventory:
execFileSync,fetch, andwriteFileSync(found inscripts/replay-runner.template.mts).\n - Sanitization: Limited to a basic regex filter for short or specific 'junk' strings; the content of the queries is not sanitized or validated.
Audit Metadata