doris-debug-data-lake
Installation
SKILL.md
Data Lake (Multi-Catalog)
Causes
| ID | Cause | Evidence | Source anchor |
|---|---|---|---|
| A | Metadata stale | Query returns old data / missing partitions after upstream write | HMSClient.java, CachedHMSClient.java |
| B | S3/HDFS connectivity | Access Denied, Timeout, NoSuchBucket |
S3FileSystem.java, HdfsResource.java |
| C | External MV rewrite miss | EXPLAIN shows no MATERIALIZED_REWRITE | MTMVService.java rewrite rules |
| D | Schema mismatch | Parquet/ORC schema ≠ Hive Metastore schema | ParquetReader.cpp, schema merge |
| E | Credential / IAM expiry | STS / IAM token rotated; 403 on S3 | S3FileSystem.java credential refresh |
| F | Too many open files | FD exhaustion listing large table directories | BE ulimit -n, FileSystem.listFiles() |
10 min triage
-- Verify catalog is alive
SHOW CATALOGS;