Desktop Ops

Overview

Expose the current macOS UI as a JSON snapshot, then act on stable refs with single-step CLI commands. Keep logic, retries, and decisions in the agent.

Workflow (Snapshot -> Ref -> Action)

1. Run desktop-ops snapshot --json.
2. Parse the tree; choose a target by role, name, value, actions, and enabled.
3. Use only the node ref for actions.
4. Re-run snapshot after any UI change.
5. Record the same sequence as a recipe if you need replay.

Ref Rules

• Treat ref as stable only for the same UI state.
• If a command returns NotFound or NotActionable, re-snapshot and pick a new ref.
• Do not guess or synthesize refs.