Databricks

Official docs

Agent rules

1. Unity Catalog — use three-level names (catalog.schema.table) when UC is enabled.
2. Cluster policy — do not upsize clusters without cost note; prefer job clusters for batch.
3. Notebooks vs repos — prefer repo-backed notebooks / Databricks Asset Bundles for prod paths.
4. Secrets — Databricks secrets scopes, not hard-coded tokens in notebooks.
5. Spark SQL dialect — not identical to ANSI SQL; verify functions against Databricks docs.