argent-ios-device-interact

Installation
SKILL.md

Physical iPhone interaction

Read this only for a physical iPhone. argent-device-interact still applies for everything not listed here.

Contract

  • Observation never changes the screen; mutation may. describe and await-ui-element fail on a backgrounded target instead of re-fronting it; await-screen-idle returns settled: false with no reason. The first describe within a second of button home can still return the old tree; describe again. Gestures and keyboard re-front it and return reactivated: true; re-describe before the next step.
  • launch-app, open-url and restart-app set the app under automation; reinstall-app clears it; a tool-server restart forgets it: launch again.
  • Each tool's description states its own hardware limits (named keys, gesture-custom shapes, buttons, edge swipes, tap counts). A gated tool fails with a bare not supported on ios device: the fix is in the list below, not in the error.

Tools on hardware

  • Only these exist: list-devices, launch-app, restart-app, reinstall-app, open-url, describe, screenshot, screenshot-diff, gesture-tap, gesture-swipe, gesture-custom, button (home, volumeUp, volumeDown, actionButton on models that have one), keyboard, await-ui-element, await-screen-idle, run-sequence, the flow tools, stop-simulator-server and stop-all-simulator-servers (session end). Every other device tool fails with not supported on ios device.
  • No two-finger gestures, rotate, shake, paste, settings-permissions, screen recording, debugger-*, react-profiler-*, native-profiler-*, native-*, boot-device: drive the app's own zoom and rotate UI with taps and drags, move the phone by hand, type with keyboard, change permissions in the phone's Settings, and debug, profile or record on a simulator.
  • gesture-swipe: durationMs sets drag speed, not time; momentum:false only rests 300 ms at the end, no damping. open-url https lands in Safari, never in the app that owns the link: pass bundleId.
Installs
829
GitHub Stars
2.5K
First Seen
5 days ago
argent-ios-device-interact — software-mansion/argent