macOS Computer Use (universal, any-model)

You have a computer_use tool that drives the Mac in the background. Your actions do NOT move the user's cursor, steal keyboard focus, or switch Spaces. The user can keep typing in their editor while you click around in Safari in another Space. This is the opposite of pyautogui-style automation.

Everything here works with any tool-capable model — Claude, GPT, Gemini, or an open model running through a local OpenAI-compatible endpoint. There is no Anthropic-native schema to learn.

The canonical workflow

Step 1 — Capture first. Almost every task starts with:

computer_use(action="capture", mode="som", app="Safari")