desktop-control
Installation
SKILL.md
Desktop Control
Unified skill for all UI automation. Chooses between CDP and Computer Use based on the target, and reports meaningful actions with a path= + action_class= transcript.
This skill is already injected into your system prompt. Do not run
sed,cat,head, orReadto load it from disk. Guessing absolute paths like/Users/*/.codex/skills/...or/Users/*/.cli-jaw-*/skills/...wastes a turn and often targets a file that doesn't exist. If you need a specific reference file (e.g.,reference/computer-use.md), usecli-jaw skill read desktop-control <ref-name>.
When to use
Trigger on any request that touches a visible UI:
- User message contains
$computer-useor/computer-use→ skip routing analysis, jump straight toreference/computer-use.md. Explicit user opt-in. If Computer Use tools are not available, stop withprecondition failed: computer-use unavailable. - "open this URL / click this button / type in this field" → read
reference/cdp.md - "switch Chrome tab / open Finder / click System Settings" → read
reference/computer-use.md - "click the thing inside this Canvas / WebGL / iframe" → read
reference/vision-click.md - Not sure which path → read
reference/intent-routing.mdFIRST - Want a real end-to-end example → read
reference/control-workflow.md