paper-reproduction-assistant

Pass

Audited by Gen Agent Trust Hub on Oct 9, 2026

Risk Level: SAFEINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTIONDATA_EXFILTRATION
Full Analysis
  • [INDIRECT_PROMPT_INJECTION]: The skill is designed to ingest and process content from untrusted external sources including research papers (PDFs/arXiv), code repositories (GitHub), datasets, and model checkpoints. This creates a significant surface for indirect prompt injection attacks where instructions hidden in the data could influence the agent's behavior.
  • Ingestion points: The skill explicitly processes papers, repositories, artifacts, datasets, models, and environment files (SKILL.md).
  • Boundary markers: The skill contains multiple instructions to "Treat external artifacts as untrusted" and to perform inspection before execution, which acts as a logical boundary, though it does not use specific technical delimiters for all interpolated content.
  • Capability inventory: The skill enables the agent to execute shell commands, manage files, and perform network downloads through its core capabilities for environment reconstruction and experiment execution.
  • Sanitization: The instructions mandate a "Security audit" (artifact-and-security.md) to check for shell interpolation, eval, and malicious hooks in external code before it is run.
  • [COMMAND_EXECUTION]: The skill's primary purpose involves executing code from third-party repositories to reproduce scientific results. While the instructions emphasize staged execution and security auditing, the agent is directed to reconstruct environments and run experimental pipelines, which involves inherent risks of executing potentially malicious code found in target repositories.
  • [DATA_EXFILTRATION]: The skill framework acknowledges the risk of data exfiltration and includes instructions to avoid exposing local secrets or mounting sensitive directories (SSH keys, cloud credentials) into untrusted containers. However, the requirement for network access to download scientific artifacts creates a potential channel that could be exploited by malicious instructions in the code being reproduced.
Audit Metadata
Risk Level
SAFE
Analyzed
Oct 9, 2026, 05:13 AM