Databricks Local Dev Loop

Overview

Set up a fast local development workflow using Databricks Connect v2, Asset Bundles, and VS Code. Databricks Connect lets you run PySpark code locally while executing on a remote Databricks cluster, giving you IDE debugging, fast iteration, and proper test isolation.

Prerequisites

• Completed databricks-install-auth setup
• Python 3.10+ (must match cluster's Python version)
• A running Databricks cluster (DBR 13.3 LTS+)
• VS Code or PyCharm

Instructions