Data Lake Platform

Build and operate production data lakes and lakehouses: ingest, transform, store in open formats, and serve analytics reliably.

Quick Reference

Task	Resource	When to Use
Pick a table format and spec version	references/storage-formats.md	Choosing Iceberg v2/v3, Delta 4.x, Hudi, Paimon, or DuckLake
Pick a catalog / control plane	references/governance-catalog.md	Choosing Polaris, Glue, Nessie, Unity, Gravitino, or Open Catalog
Design ingestion or CDC path	references/ingestion-patterns.md	dlt, Airbyte, Debezium, Flink CDC
Scaffold or inspect an Iceberg table	`scripts/scaffold_iceberg_table.py`, `scripts/inspect_iceberg_metadata.sh`	New table DDL or auditing an existing table's file/metadata layout
Sanity-check an interoperability or version claim	`data/sources.json` + Fact-Checking below	Any claim about spec-version GA status, engine support, or vendor feature