spark-migration
Installation
SKILL.md
Spark Migration
Routes Spark → Snowflake conversion requests to one of two bundled paths and owns the cross-path configuration, intent classification, and per-step dispatch.
⛔ Default Path: Snowpark Connect (SCOS)
Any unqualified request to "convert spark", "migrate pyspark", "migrate to snowpark", etc. routes to snowpark-connect/SKILL.md, which preserves the PySpark API surface (withColumn, groupBy, spark.createDataFrame). This is the recommended default for the vast majority of users.
Route to snowpark-api/SKILL.md (SMA CLI / snowflake.snowpark snake_case rewrite) only when the user explicitly mentions:
- "SMA", "SMA CLI", or "run sma"
- "Snowpark API" or "
snowflake.snowpark" - An already-migrated SMA output (intents like "open sma dashboard", "fix ewis", "run stage conversion", "resume dvp")
- An existing project config with
conversion_typeset tosnowpark-api(or any legacy alias)
If the intent is ambiguous, ask the user which path they want — do not silently default to the SMA path.