decoupling-skeleton-flesh-multimodal

Installation
SKILL.md

Decoupling Skeleton and Flesh: Disentangled Table Reasoning

This skill enables Claude to reason over table images and structured tabular data by applying the DiSCo + Table-GLS framework from Zhu et al. (2026). The core idea: instead of trying to understand a table all at once, explicitly decouple structure (skeleton) from content (flesh) first, then use a global-to-local reasoning pipeline that narrows focus from the full table to a minimal evidence sub-table before answering. This dramatically reduces errors from misaligned rows/columns, merged cells, and complex hierarchical headers.

When to Use

  • When the user provides a table image (screenshot, photo, scan) and asks questions about its contents
  • When the user asks to extract structured data from a visual table representation
  • When reasoning requires cross-referencing multiple cells (e.g., "which product had the highest growth between Q2 and Q4?")
  • When tables have complex layouts: merged cells, multi-level headers, hierarchical row labels, or irregular grids
  • When the user needs to compare, aggregate, or compute values scattered across a table image
  • When building a table QA pipeline that must handle diverse, unseen table formats robustly
  • When converting a table image to structured format (JSON, CSV, DataFrame) with layout fidelity

Key Technique: Disentangled Alignment + Structure-Guided Reasoning

The Problem with Naive Table Reading

Large vision-language models tend to entangle structure and content when reading tables. They might correctly OCR individual cell values but misattribute which row or column a value belongs to--especially in tables with merged headers, irregular spacing, or dense numeric data. This leads to confidently wrong answers.

Installs
1
GitHub Stars
6
First Seen
Jun 19, 2026
decoupling-skeleton-flesh-multimodal — ndpvt-web/arxiv-claude-skills