idea-spark
Pass
Audited by Gen Agent Trust Hub on Sep 10, 2026
Risk Level: SAFEINDIRECT_PROMPT_INJECTIONCOMMAND_EXECUTIONEXTERNAL_DOWNLOADS
Full Analysis
- Indirect Prompt Injection Surface: The skill fetches and processes significant amounts of untrusted data from external sources (academic papers via arXiv, OpenAlex, Semantic Scholar, and OpenReview). If a paper contains malicious prompt instructions in its abstract or method section, it could influence the agent's behavior during analysis phases.
- Ingestion points: Data enters the system via
scripts/search_arxiv.py,scripts/search_openalex.py,scripts/search_semanticscholar.py,scripts/search_openreview.py, andscripts/fetch_sections.py. Results are stored inphase0/lit_results.jsonandphase0/fulltext_cache.json. - Boundary markers: Boundary markers are largely absent in prompts like
references/system-prompts/bottleneck_identify.txtandreferences/system-prompts/ideate_generate.txtwhen interpolating fetched paper content. - Capability inventory: The orchestrator
scripts/run.pyhas the ability to execute shell commands, write to the file system, and perform network operations. - Sanitization: There is no specific sanitization or filtering of fetched paper content before it is processed by the agent.
- Command Execution through Configuration: The scripts
scripts/intent.pyandscripts/pattern_summary.pyusesubprocess.runwithshell=Trueto execute commands defined in the environment variablesNOVELTY_LLM_REASONING_LARGE_CMDandNOVELTY_LLM_CLASSIFY_FAST_CMD. This is a design choice to allow users to configure their own LLM interfaces, but it means that the environment in which the skill runs must be trusted, as an attacker controlling these variables could execute arbitrary shell commands. - External Data Retrieval: The skill makes legitimate network requests to several well-known academic domains to gather research data. While these are trusted services, the skill downloads and processes PDFs and HTML content from them, which is a necessary but potentially risky operation if the source content is compromised.
Audit Metadata