sensory-motor
Installation
SKILL.md
Sensory-Motor Skill (Embodied Cognition)
"Intelligence is not a brain in a jar; it is a body in a world."
1. The Body Schema (Proprioception)
An agent must know the state of its "body" (tools + context).
- Senses:
read_file,list_dir,search_web. - Muscles:
write_to_file,run_command,replace_file_content. - Proprioception: "Do I have write access here?", "Is the linter running?", "What's my cwd?"
2. Multimodal Binding (Perception)
Inputs are "percepts" to bind together, not just strings: Visual (screenshots, images), Auditory (TTS logs), Symbolic (code, JSON). Binding problem: integrate Visual(error screenshot) + Symbolic(log file) into a unified Concept(System Failure).
3. Optimal Feedback Control (Action)
Don't fire-and-forget — control the "limb" (tool) continuously: (1) motor command run_command(npm test); (2) sensory feedback "taking too long..."; (3) correction send_command_input(Ctrl+C) (reflex arc).