beyond-accuracy-cognitive-load

Installation
SKILL.md

Cognitive Load Framework for Tool-Use Agent Design

This skill applies the Cognitive Load Framework (Wang et al., AAAI 2026) to diagnose, analyze, and reduce the complexity of tool-use agent workflows. Instead of treating agent failures as opaque accuracy drops, this framework decomposes task complexity into two quantifiable axes -- Intrinsic Load (structural complexity of the tool dependency chain) and Extraneous Load (ambiguity in how the task and tools are presented) -- enabling you to identify exactly where and why an agent pipeline breaks, then restructure it to stay within capability boundaries.

When to Use

  • When a multi-tool agent pipeline has unreliable success rates and you need to diagnose the root cause
  • When designing a new tool-calling workflow and you want to predict whether an LLM can handle the complexity
  • When an agent must choose among many similar tools and keeps picking the wrong one (parameter confusion)
  • When you need to simplify an existing agent orchestration to improve reliability
  • When evaluating whether a task should be decomposed into sub-agents vs. handled by a single agent
  • When building tool descriptions/schemas and you want to minimize ambiguity that causes failures
  • When comparing whether a workflow is within the capability boundary of a given model tier

Key Technique

The framework borrows from Cognitive Load Theory in educational psychology, which distinguishes between intrinsic load (inherent difficulty of the material) and extraneous load (unnecessary difficulty from poor presentation). Applied to tool-use agents:

Intrinsic Load is formalized via the Tool Interaction Graph (TIG) -- a directed acyclic graph where nodes are tool calls and edges represent data dependencies (one tool's output feeds another's input). The key measurable properties are: (1) depth -- the longest chain of sequential tool calls, (2) branching factor -- how many tool choices exist at each decision point, and (3) dependency density -- how many cross-tool data handoffs are required. Empirically, models hit sharp performance cliffs at TIG depth >= 5, branching factor > 6, and when these compound together.

Installs
1
GitHub Stars
6
First Seen
3 days ago
beyond-accuracy-cognitive-load — ndpvt-web/arxiv-claude-skills