Computer Controls

OS-level mouse, keyboard, and screen control for precise browser interaction.

When to Use

Computer controls provide OS-level interaction with the browser VM, operating at the system level rather than through browser APIs. Use computer controls when:

• Playwright/CDP isn't sufficient: When you need to interact with elements that are difficult to target via DOM selectors
• Testing real user behavior: Simulating actual mouse movements, clicks, and keyboard input as a human would perform them
• Interacting with browser UI: Clicking on browser chrome elements (address bar, extensions, menus) that aren't accessible via page automation
• Handling complex interactions: Drag-and-drop operations, hover effects, or interactions that require precise coordinate-based control
• Capturing visual output: Taking screenshots of the entire browser viewport or specific screen regions
• Working with canvas/WebGL: Interacting with canvas elements or games where DOM-based automation doesn't work
• Bypassing automation detection: Some anti-bot systems detect Playwright/CDP usage but not OS-level input