sensory-motor

Installation
SKILL.md

Sensory-Motor Skill (Embodied Cognition)

"Intelligence is not a brain in a jar; it is a body in a world."

1. The Body Schema (Proprioception)

An agent must know the state of its "body" (tools + context).

  • Senses: read_file, list_dir, search_web.
  • Muscles: write_to_file, run_command, replace_file_content.
  • Proprioception: "Do I have write access here?", "Is the linter running?", "What's my cwd?"

2. Multimodal Binding (Perception)

Inputs are "percepts" to bind together, not just strings: Visual (screenshots, images), Auditory (TTS logs), Symbolic (code, JSON). Binding problem: integrate Visual(error screenshot) + Symbolic(log file) into a unified Concept(System Failure).

3. Optimal Feedback Control (Action)

Don't fire-and-forget — control the "limb" (tool) continuously: (1) motor command run_command(npm test); (2) sensory feedback "taking too long..."; (3) correction send_command_input(Ctrl+C) (reflex arc).

Installs
1
GitHub Stars
23
First Seen
Oct 14, 2026