hallucinating-labels
Warn
Audited by Gen Agent Trust Hub on Oct 13, 2026
Risk Level: MEDIUMDYNAMIC_EXECUTIONCOMMAND_EXECUTIONINDIRECT_PROMPT_INJECTIONEXTERNAL_DOWNLOADS
Full Analysis
- [DYNAMIC_EXECUTION]: The skill uses the Python
picklemodule to serialize and deserialize embedding indexes. Python'spicklemodule is notoriously insecure and can execute arbitrary code during the loading process if a malicious index file is provided. - Evidence: The
snapcommand inscripts/snap.pycallspickle.load(fh)to load the index file specified by the--indexargument. - [DYNAMIC_EXECUTION]: The skill's test suite uses the
eval()function to dynamically parse strings extracted from the source code, which is a dangerous practice that can lead to code execution if the source file is manipulated. - Evidence: In
tests/test_snap.py, the functiontest_documented_backends_are_all_constructiblereads the script text and callseval()on a portion of the code to extract CLI choices. - [COMMAND_EXECUTION]: The test suite invokes the skill's CLI script using system calls, which involves shell command execution.
- Evidence:
tests/test_snap.pyusessubprocess.run()to execute thesnap.pyscript for various integration tests. - [INDIRECT_PROMPT_INJECTION]: The skill ingests external data from multiple files for embedding comparison, which could be exploited by embedding malicious instructions in the processed items or labels.
- Ingestion points: Data is read from files provided via the
--vocab,--labels, and--itemsarguments inscripts/snap.py. - Boundary markers: There are no explicit delimiters or instructions to ignore embedded commands in the ingested data.
- Capability inventory: The skill has the capability to read and write local files (via pickle and stdout redirection) and performs vector calculations. It does not have direct network or high-privilege system access.
- Sanitization: No sanitization or filtering of input strings is performed before they are passed to the embedding models (
TfidfVectorizerorSentenceTransformer). - [EXTERNAL_DOWNLOADS]: The skill can fetch pre-trained models from a well-known service if a specific backend is enabled.
- Evidence: Selecting the
minilmbackend inscripts/snap.pytriggers thesentence-transformerslibrary to download models from Hugging Face. This is a standard operation for this type of tool.
Audit Metadata