eval-run
Pass
Audited by Gen Agent Trust Hub on Oct 9, 2026
Risk Level: SAFE
Full Analysis
- [SAFE]: The skill implements strong security defaults for its reporting functionality. The report generators in
templates/report.pyandtemplates/report.mjsexplicitly escape all untrusted inputs and outputs using standard HTML escaping to prevent cross-site scripting (XSS) when viewing evaluation results. - [SAFE]: The artifact validation script
scripts/artifacts.pyincludes proactive path traversal protections. It enforces that file references remain within the evaluation bundle's root directory and forbids absolute paths or parent directory traversal (..). - [SAFE]: Network operations in
templates/upload_results.pyandtemplates/upload-results.mjsare restricted to the vendor's official domains (api.confident-ai.comandeu.api.confident-ai.com). These tools are used for the intended purpose of uploading evaluation metrics to the Confident AI platform and rely on user-provided API keys stored in environment variables rather than hardcoded secrets. - [DYNAMIC_EXECUTION]: The evaluation runners (
run_evals.pyandrun-evals.ts) use dynamic loading to execute local project files, such as application adapters and grader definitions. This is a core requirement for the skill's purpose of testing local code. The implementation uses standard runtime mechanisms (importlibin Python and dynamicimport()in Node.js) to load these user-supplied local modules. - [COMMAND_EXECUTION]: The skill uses shell commands (e.g.,
git rev-parse HEAD) to capture the current state of the application repository for result reproducibility. This behavior is standard for development tools and is used to uniquely identify the version of the code being evaluated.
Audit Metadata