The Agent Skills Directory

[EXTERNAL_DOWNLOADS]: The ensure_dependencies function in scripts/utils.py automatically downloads and installs the pyautogui and pillow packages from the official Python Package Index (PyPI) using pip if they are not already available on the system.
[COMMAND_EXECUTION]: The skill uses subprocess.check_call in scripts/utils.py to execute the system's Python interpreter and run pip installation commands for dependency management.
[INDIRECT_PROMPT_INJECTION]: The skill exposes high-privilege UI automation capabilities that could be exploited if the agent processes malicious data from an untrusted external source (e.g., a website or document) and uses that data as input for automation commands like type_text or click.
Ingestion points: Data supplied to parameters such as --text in scripts/automation.py, which is subsequently passed to the pyautogui.typewrite function in scripts/keyboard.py.
Boundary markers: No delimiters or instructions are used to distinguish between legitimate user commands and potentially malicious instructions embedded in processed data.
Capability inventory: The skill possesses full control over user input devices (mouse and keyboard), can capture the entire screen, and can interact with active windows on Windows systems via the pywin32 library.
Sanitization: Input text is passed directly to the automation library without validation or sanitization, allowing for the potential injection of special keys or unintended control sequences.

pyautogui-automation