matlab-connect-databricks-spark
Installation
SKILL.md
MATLAB Interface for Databricks — Spark (Databricks Connect)
Read data from Databricks into MATLAB via Databricks Connect. This skill covers first-time setup, authentication, and using Spark DataFrames from desktop MATLAB.
When to Use
- First-time setup of the MATLAB Interface for Databricks package
- Configuring
.databrickscfgand authentication (OauthU2M, OauthM2M, PAT) - Reading large tables via Spark with server-side filtering before pulling data locally
- Creating a Spark session from desktop MATLAB (
getDatabricksSession) - Converting Spark DataFrames to MATLAB tables or writing MATLAB tables back to Spark
When NOT to Use
- SQL queries on small-to-medium datasets via JDBC/ODBC — use
/matlab-connect-databricks-jdbc - Deploying compiled MATLAB code to Databricks clusters (Job workflow)
- Databricks Files API operations
- REST API management (Clusters, Jobs, Unity Catalog admin)