spark-operations-cli
Pass
Audited by Gen Agent Trust Hub on Jul 10, 2026
Risk Level: SAFECOMMAND_EXECUTIONEXTERNAL_DOWNLOADS
Full Analysis
- Cloud Service Interaction: The skill leverages the Azure CLI (
az rest) to interact with Microsoft Fabric APIs. This enables the discovery of workspaces and the management of Spark sessions within the vendor's cloud ecosystem. - Diagnostic Script Execution: It includes instructions for submitting PySpark and Scala code snippets to remote Spark environments via the Livy API. This capability is used specifically for gathering environment-specific diagnostics and cluster metrics such as executor memory and parallelism.
- Secure Authentication Practices: The skill obtains access tokens dynamically through the user's existing CLI session using
az account get-access-token. This eliminates the need for hardcoded credentials and ensures that operations are performed under the user's own identity and permission set. - Handling of External Data: Automated workflows process tracebacks and logs from Spark jobs. This data is used to provide context-aware troubleshooting advice and to generate diagnostic reports for the user, following standard data science diagnostic patterns.
- Trusted Resource Retrieval: The skill provides commands for downloading Spark event logs from the trusted
onelake.dfs.fabric.microsoft.comdomain. These files are used locally by standard diagnostic tools like the Spark History Server to provide deeper visual insights into job execution.
Audit Metadata