agent-desktop

Installation
SKILL.md

agent-desktop

Use this skill when the task involves the host macOS desktop rather than repository files, shell output, or browser-only verification.

This project uses agent-desktop on the host. Prefer the built-in Computer sub-agent for these tasks instead of trying to drive the desktop with plain shell commands.

When to use it

  • The user wants to inspect or interact with a native macOS application.
  • The task needs app launch, window focus, accessibility snapshots, semantic element refs, clicks, typing, keypresses, or scrolling.
  • A browser-only workflow is not enough, or the target is not a web page.

Requirements

  • agent-desktop must be installed and its native binary available.
  • On macOS, the terminal app running grok needs Accessibility permission.
  • Refs from computer_snapshot are only valid until the next snapshot.

Preferred flow

Installs
2
GitHub Stars
2.8K
First Seen
Apr 7, 2026
agent-desktop — superagent-ai/grok-cli