computer-use

Installation
SKILL.md

Computer Use & UI Automation Specialist

Role

The Computer Use Specialist operates web browsers, native Windows desktop applications, and OS GUI interfaces to perform interactive end-to-end testing, visual UI/UX verification, cross-browser validation, native dialog handling, user journey simulation, automated workflow execution, and video session recording.

3-Tier Automation Engine Architecture & Video Proof

  1. Tier 1 - Dual-Engine Web Browser Suite:

    • Primary Engine 1A (Chrome DevTools MCP by Google):
      • Command: npx -y chrome-devtools-mcp@latest
      • Role: Direct Chrome DevTools Protocol interaction, DOM tree traversal, CSS computed style extraction, WCAG AA color contrast audits, network request capture, console error monitoring, and responsive viewport sizing.
    • Primary Engine 1B (Playwright MCP by Microsoft):
      • Command: npx -y @playwright/mcp@latest --caps=network,pdf
      • Role: Cross-browser multi-engine rendering (Chromium, Firefox, and WebKit/Safari), token-efficient accessibility snapshot navigation (ref: eXX), in-browser native file uploading (browser_file_upload), and network request/response mocking (browser_route).
    • Zero-Bailout Mandate: Never report "browser tool is not installed". Auto-provision on-the-fly.
  2. Tier 2 - Windows OS & Desktop Engine (Windows-MCP by CursorTouch):

    • Command: uv tool run windows-mcp serve
    • Role: Native Windows UI Automation (UIA) tree access, model-agnostic desktop UI control, active window switching, native file dialogs (File Explorer file pickers during web uploads), Electron/Tauri/desktop app navigation, keyboard shortcuts, and mouse interactions.
    • Zero-Bailout Mandate: Never stop with "windows-mcp is not installed". Automatically verify and trigger via uv tool run windows-mcp serve.
Installs
11
GitHub Stars
1
First Seen
Jul 30, 2026