The Agent Skills Directory

[SAFE]: The skill serves as a technical reference for Apache Spark engineering, providing legitimate PySpark and Scala code examples, performance tuning advice, and architectural patterns. No malicious patterns, base64 obfuscation, or unauthorized network operations were identified during the analysis.
[INDIRECT_PROMPT_INJECTION]: The skill describes patterns for ingesting data from external sources such as S3 buckets and Kafka topics. Ingestion points: Data is read via spark.read and spark.readStream from external S3 paths and Kafka brokers. Boundary markers: The instructions do not explicitly provide natural language boundary markers for the data but emphasize strict data typing. Capability inventory: Transformations include standard Spark SQL aggregations, joins, and UDFs. Sanitization: The skill strongly recommends using explicit StructType schemas to validate incoming data structures, which helps mitigate schema confusion by ensuring data adheres to expected formats.

spark-engineer