arxiv
Fail
Audited by Gen Agent Trust Hub on Sep 8, 2026
Risk Level: HIGHINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADS
Full Analysis
- [INDIRECT_PROMPT_INJECTION]: The skill is designed to ingest and process academic paper metadata from external sources, creating a surface for potential prompt injection via malicious paper titles or abstracts.
- Ingestion points: The skill fetches Atom XML from
export.arxiv.organd JSON data fromapi.semanticscholar.org(found inSKILL.md). - Boundary markers: Data is parsed and directly outputted or passed to other tools (like
web_extract) without explicit boundary markers or instructions to ignore embedded commands. - Capability inventory: The agent has network access via
curl, the ability to extract web content usingweb_extract, and local command execution viapython -c. - Sanitization: Basic string cleaning is performed (e.g.,
.strip(),.replace('\n', ' ')), but no security-focused sanitization is implemented to prevent the agent from following instructions embedded in research abstracts. - [COMMAND_EXECUTION]: The skill provides numerous examples of piping network output directly into a Python interpreter for processing.
- Evidence: Multiple instances in
SKILL.mdwherecurlcommands are piped topython -cto execute multi-line XML or JSON parsing scripts provided within the skill content. - Context: While automated scanners flagged these as remote code execution, the code executed is statically defined within the skill body and is used for parsing data from trusted academic APIs, rather than executing downloaded remote scripts.
- [EXTERNAL_DOWNLOADS]: The skill connects to well-known academic services to retrieve paper data.
- Details: Regularly fetches metadata and citation information from
export.arxiv.organdapi.semanticscholar.org. These are recognized as legitimate, well-known services for academic research.
Recommendations
- HIGH: Downloads and executes remote code from: https://api.semanticscholar.org/graph/v1/paper/arXiv:2402.03300?fields=title,authors,citationCount,referenceCount,influentialCitationCount,year,abstract, https://export.arxiv.org/api/query?id_list=1706.03762, https://export.arxiv.org/api/query?search_query=all:GRPO+reinforcement+learning&max_results=5&sortBy=submittedDate&sortOrder=descending - DO NOT USE without thorough review
Audit Metadata