langsmith-fetch
Fail
Audited by Gen Agent Trust Hub on Apr 7, 2026
Risk Level: HIGHCREDENTIALS_UNSAFECOMMAND_EXECUTIONDATA_EXFILTRATIONEXTERNAL_DOWNLOADS
Full Analysis
- [CREDENTIALS_UNSAFE]: The skill explicitly instructs the agent to run
echo $LANGSMITH_API_KEY. This causes the sensitive LangSmith API key to be printed to the terminal, exposing it to the agent's context, history, and logs. - [PERSISTENCE_MECHANISMS]: In the troubleshooting section, the skill provides instructions to modify the user's shell configuration:
echo 'export LANGSMITH_API_KEY="your_key"' >> ~/.bashrc. This is a persistence mechanism that permanently alters the environment variables on the host system. - [EXTERNAL_DOWNLOADS]: The skill requires the installation of
langsmith-fetchviapip. This is a third-party package that is not the official LangChain SDK (langsmith). - [METADATA_POISONING]: The skill claims a resource at
https://github.com/langchain-ai/langsmith-fetch. This repository does not exist under the official LangChain organization, which is a deceptive metadata practice used to imply official support for a third-party tool. - [INDIRECT_PROMPT_INJECTION]: The skill processes execution traces from an external service (LangSmith) and instructs the agent to "Analyze and report" on the findings. This creates a surface for indirect prompt injection if an attacker can influence the content of the traces (e.g., tool outputs or error messages) to manipulate the agent's analysis.
- Ingestion points: Commands like
langsmith-fetch traces --format json > recent-traces.jsoningest untrusted execution data into the agent's workflow. - Boundary markers: None. The skill does not provide delimiters or instructions for the agent to ignore embedded instructions within the traces.
- Capability inventory: The skill has access to shell execution (
bash), file system modification (mkdir, redirection), and environment variable access. - Sanitization: None. The data is piped directly to files and processed by the LLM.
Recommendations
- AI detected serious security threats
Audit Metadata