spark-optimization
Pass
Audited by Gen Agent Trust Hub on Oct 27, 2026
Risk Level: SAFE
Full Analysis
- [SAFE]: The skill is a comprehensive guide for Spark optimization, covering partitioning, memory tuning, and shuffle management. All code snippets use standard PySpark APIs and follow industry best practices for data engineering.
- [EXTERNAL_DOWNLOADS]: The skill references documentation from Apache Spark and Databricks. These are recognized as well-known and trusted technology services, and the references are relevant to the skill's primary purpose.
- [INDIRECT_PROMPT_INJECTION]: The skill demonstrates reading data from external S3 storage, which is an inherent part of Spark data processing workflows.
- Ingestion points:
spark.read.parquetandspark.tableoperations inSKILL.md. - Boundary markers: None present, as the skill focuses on job optimization rather than processing untrusted natural language input.
- Capability inventory: The skill utilizes Spark job execution and file-write capabilities (
result.write.parquet). - Sanitization: No specific input sanitization is present, which is standard for performance tuning instructions.
Audit Metadata