databricks-lakeflow-connect

Installation
SKILL.md

Lakeflow Connect

Build managed ingestion pipelines that pull from SaaS apps and databases into Unity Catalog Delta tables, governed end-to-end and powered by serverless Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables / DLT).

Status: mixed catalog — GA connectors for production use, plus Public Preview, Beta, and Private Preview connectors that expand over time. See the connector catalog below.


What Is Lakeflow Connect?

Managed connectors for ingesting data from SaaS applications and databases. The resulting ingestion pipeline is governed by Unity Catalog and powered by serverless compute and Lakeflow Spark Declarative Pipelines.

Three frames to keep in mind:

  • Simple and low-maintenance — no client code to write, no message bus to operate; connector + UC Connection + a serverless pipeline.
  • Unified with the lakehouse — credentials stored in UC, output is governed Delta, runs on Jobs and SDP like any other workload.
  • Efficient incremental processing — change tracking / CDC / schema evolution / retries are built in.

There are four architecture patterns:

Installs
29
GitHub Stars
193
First Seen
10 days ago
databricks-lakeflow-connect — databricks/databricks-agent-skills