spark-migration

Installation
SKILL.md

Spark Migration

Routes Spark → Snowflake conversion requests to one of two bundled paths and owns the cross-path configuration, intent classification, and per-step dispatch.

⛔ Default Path: Snowpark Connect (SCOS)

Any unqualified request to "convert spark", "migrate pyspark", "migrate to snowpark", etc. routes to snowpark-connect/SKILL.md, which preserves the PySpark API surface (withColumn, groupBy, spark.createDataFrame). This is the recommended default for the vast majority of users.

Route to snowpark-api/SKILL.md (SMA CLI / snowflake.snowpark snake_case rewrite) only when the user explicitly mentions:

  • "SMA", "SMA CLI", or "run sma"
  • "Snowpark API" or "snowflake.snowpark"
  • An already-migrated SMA output (intents like "open sma dashboard", "fix ewis", "run stage conversion", "resume dvp")
  • An existing project config with conversion_type set to snowpark-api (or any legacy alias)

If the intent is ambiguous, ask the user which path they want — do not silently default to the SMA path.

⛔ Deploy Path (notebook or code bundle)

Installs
6
GitHub Stars
31
First Seen
12 days ago
spark-migration — snowflake-labs/coco-skills