benchmark-model-kernels
Pass
Audited by Gen Agent Trust Hub on Aug 17, 2026
Risk Level: SAFECOMMAND_EXECUTIONREMOTE_CODE_EXECUTION
Full Analysis
- [REMOTE_CODE_EXECUTION]: The
scripts/benchmark_model.pyscript leverages the Hugging Facetransformerslibrary to load model configurations and architectures. It exposes thetrust_remote_codeflag, which allows the execution of arbitrary Python code from within a model's repository. The skill mitigates this risk by explicitly instructing the agent not to enable this flag without user approval and recommending the use of specific commit revisions to ensure supply chain security. - [COMMAND_EXECUTION]: The
scripts/benchmark_via_builtin.pyscript uses thesubprocessmodule to execute system commands, such as running the FlashInfer benchmark driver and querying repository metadata viagit. These executions are performed using list-based arguments rather than shell strings, which prevents shell injection vulnerabilities. These operations are restricted to the local environment and user-specified directories as required for benchmarking. - [DYNAMIC_EXECUTION]: The script
scripts/benchmark_model.pydynamically loads its companion scriptscripts/benchmark_via_builtin.pyusingimportlib.util. This is a standard modularization technique for Python applications and does not involve executing unverified code from external or untrusted sources.
Audit Metadata