decoupling-skeleton-flesh-multimodal
Decoupling Skeleton and Flesh: Disentangled Table Reasoning
This skill enables Claude to reason over table images and structured tabular data by applying the DiSCo + Table-GLS framework from Zhu et al. (2026). The core idea: instead of trying to understand a table all at once, explicitly decouple structure (skeleton) from content (flesh) first, then use a global-to-local reasoning pipeline that narrows focus from the full table to a minimal evidence sub-table before answering. This dramatically reduces errors from misaligned rows/columns, merged cells, and complex hierarchical headers.
When to Use
- When the user provides a table image (screenshot, photo, scan) and asks questions about its contents
- When the user asks to extract structured data from a visual table representation
- When reasoning requires cross-referencing multiple cells (e.g., "which product had the highest growth between Q2 and Q4?")
- When tables have complex layouts: merged cells, multi-level headers, hierarchical row labels, or irregular grids
- When the user needs to compare, aggregate, or compute values scattered across a table image
- When building a table QA pipeline that must handle diverse, unseen table formats robustly
- When converting a table image to structured format (JSON, CSV, DataFrame) with layout fidelity
Key Technique: Disentangled Alignment + Structure-Guided Reasoning
The Problem with Naive Table Reading
Large vision-language models tend to entangle structure and content when reading tables. They might correctly OCR individual cell values but misattribute which row or column a value belongs to--especially in tables with merged headers, irregular spacing, or dense numeric data. This leads to confidently wrong answers.