The Agent Skills Directory

[COMMAND_EXECUTION]: The skill utilizes standard shell utilities including curl, awk, and grep in references/checks.md to parse and filter information from web resources. These tools are used appropriately for technical auditing tasks.
[EXTERNAL_DOWNLOADS]: The skill uses curl to fetch content from public web targets defined by user-supplied variables like $SITE and $URL. This behavior is limited to the skill's primary purpose of inspecting crawler configurations (robots.txt and headers).

robots-ai-crawler-audit