langsmith-fetch

Fail

Audited by Gen Agent Trust Hub on Apr 7, 2026

Risk Level: HIGHCREDENTIALS_UNSAFECOMMAND_EXECUTIONDATA_EXFILTRATIONEXTERNAL_DOWNLOADS
Full Analysis
  • [CREDENTIALS_UNSAFE]: The skill explicitly instructs the agent to run echo $LANGSMITH_API_KEY. This causes the sensitive LangSmith API key to be printed to the terminal, exposing it to the agent's context, history, and logs.
  • [PERSISTENCE_MECHANISMS]: In the troubleshooting section, the skill provides instructions to modify the user's shell configuration: echo 'export LANGSMITH_API_KEY="your_key"' >> ~/.bashrc. This is a persistence mechanism that permanently alters the environment variables on the host system.
  • [EXTERNAL_DOWNLOADS]: The skill requires the installation of langsmith-fetch via pip. This is a third-party package that is not the official LangChain SDK (langsmith).
  • [METADATA_POISONING]: The skill claims a resource at https://github.com/langchain-ai/langsmith-fetch. This repository does not exist under the official LangChain organization, which is a deceptive metadata practice used to imply official support for a third-party tool.
  • [INDIRECT_PROMPT_INJECTION]: The skill processes execution traces from an external service (LangSmith) and instructs the agent to "Analyze and report" on the findings. This creates a surface for indirect prompt injection if an attacker can influence the content of the traces (e.g., tool outputs or error messages) to manipulate the agent's analysis.
  • Ingestion points: Commands like langsmith-fetch traces --format json > recent-traces.json ingest untrusted execution data into the agent's workflow.
  • Boundary markers: None. The skill does not provide delimiters or instructions for the agent to ignore embedded instructions within the traces.
  • Capability inventory: The skill has access to shell execution (bash), file system modification (mkdir, redirection), and environment variable access.
  • Sanitization: None. The data is piped directly to files and processed by the LLM.
Recommendations
  • AI detected serious security threats
Audit Metadata
Risk Level
HIGH
Analyzed
Apr 7, 2026, 03:21 PM
Security Audit — agent-trust-hub — langsmith-fetch