llm-finetuning
Pass
Audited by Gen Agent Trust Hub on Sep 25, 2026
Risk Level: SAFEEXTERNAL_DOWNLOADSINDIRECT_PROMPT_INJECTION
Full Analysis
- [EXTERNAL_DOWNLOADS]: The skill downloads model weights from Hugging Face and a vehicle complaint dataset from the official NHTSA website. These are reputable and well-known sources for machine learning research and public safety data.
- [INDIRECT_PROMPT_INJECTION]: The skill processes external text datasets which could theoretically contain malicious instructions. However, it implements security best practices by using the
train_on_responses_onlyfeature to mask prompts during training, ensuring the model only learns from designated response fields. It also includes functions to clean model output and uses structured JSON parsing for multi-target classification tasks. - Ingestion points:
scripts/demo.py(viaload_dataset) andscripts/demo_nhtsa.py(viarequests.get). - Boundary markers: Instruction and response masking tokens are explicitly defined and applied using
train_on_responses_onlyin both demo scripts. - Capability inventory: The skill performs network operations to fetch data/models and writes training artifacts to local temporary directories.
- Sanitization: The
_strip_thinkingfunction in both demo scripts removes internal reasoning blocks, and_parse_predictionindemo_nhtsa.pyuses JSON schema validation.
Audit Metadata