flaky-smoke-tests

Pass

Audited by Gen Agent Trust Hub on Nov 2, 2026

Risk Level: SAFEEXTERNAL_DOWNLOADSCOMMAND_EXECUTIONINDIRECT_PROMPT_INJECTION
Full Analysis
  • Remote Resource Access: The skill utilizes the Azure CLI (az) to interact with the Azure DevOps organization monacotools. This involves fetching pipeline timelines, downloading build logs, and listing artifacts. These operations are standard for a CI/CD diagnostic tool and are directed at the vendor's own infrastructure.
  • Pipeline Interaction: The skill provides instructions to queue focused validation runs using az pipelines run. This capability allows the agent to trigger remote build processes on defined branches. While this involves remote execution, it is an intended feature of the diagnostic workflow within the specified project scope.
  • Indirect Prompt Injection Surface: The skill is designed to ingest and analyze external data sources, specifically smoke-test-runner.log and Azure DevOps task logs (task-log.json).
  • Ingestion points: Data enters the context via az devops invoke and artifact downloads in SKILL.md (Sections 3 and 4).
  • Boundary markers: The instructions do not explicitly define boundary markers or delimiters when interpreting log content.
  • Capability inventory: The agent has the ability to trigger new pipelines (az pipelines run) and perform local compilation (npm run compile).
  • Sanitization: There is no explicit mention of sanitizing or filtering log content before processing.
  • Context: Because the primary purpose of the skill is log analysis, the inherent risk of processing potentially manipulated log output is considered within the scope of its operational utility.
Audit Metadata
Risk Level
SAFE
Analyzed
Nov 2, 2026, 06:24 AM