skill-upper
Fail
Audited by Gen Agent Trust Hub on May 20, 2026
Risk Level: HIGHREMOTE_CODE_EXECUTIONCOMMAND_EXECUTIONPROMPT_INJECTION
Full Analysis
- [REMOTE_CODE_EXECUTION]: The skill instructs the agent to download and execute an installation script directly from the vendor's public GitHub repository using a piped-to-bash pattern. This is a common installation method for developer tools but carries inherent risks of executing remote code.
- Evidence:
curl -fsSL https://raw.githubusercontent.com/alibaba/skill-up/main/install.sh | bashinSKILL.md(Step 0). - [COMMAND_EXECUTION]: The skill performs shell operations to verify the environment, check for existing API keys, and run the evaluation tool. It also generates and writes executable grading scripts (Python/Shell) based on user-provided templates.
- Evidence: Execution of
command -v skill-up,skill-up run, andprintenv | grep -E 'ANTHROPIC_API_KEY|OPENAI_API_KEY|QODER_PERSONAL_ACCESS_TOKEN'inSKILL.md. - Evidence: Logic for generating
script_pathand grading scripts described inreferences/judge-types.mdandevals/cases/scaffold-with-script-judge.yaml. - [PROMPT_INJECTION]: The skill processes untrusted local data (such as the target skill's
SKILL.mdor existingeval.yamlfiles) to scaffold new test cases. This creates an indirect prompt injection surface where malicious content in a project file could influence the agent's behavior during the scaffolding process. - Ingestion points: Reads local project files including
SKILL.mdand theevals/directory to understand skill capabilities (Step 1 inSKILL.md). - Boundary markers: No explicit boundary markers or instruction-ignoring delimiters are used when interpolating file content into generation prompts.
- Capability inventory: The agent has capabilities to execute shell commands via the
skill-upCLI, read/write files, and access environment variables. - Sanitization: No explicit sanitization or validation of the ingested file contents is mentioned before they are used to generate test prompts.
Recommendations
- HIGH: Downloads and executes remote code from: https://raw.githubusercontent.com/alibaba/skill-up/main/install.sh - DO NOT USE without thorough review
Audit Metadata