The Agent Skills Directory

[COMMAND_EXECUTION]: The skill documents the use of crw crawl and curl commands to interact with a web crawling service. These are provided as instructional examples for the user or agent to perform legitimate website extraction tasks.
[EXTERNAL_DOWNLOADS]: The skill references the homepage (fastcrw.com) and repository (github.com/us/crw) for the tool. Both resources are owned by the vendor 'us' and represent standard project metadata.
[DATA_EXFILTRATION]: The skill demonstrates how to use the CRW_API_KEY environment variable within curl headers. It correctly advises the use of standard environment variables for secret management rather than hardcoding credentials.
[SAFE]: The logic and instructions follow security best practices, such as recommending 'map first' to verify scope before performing large crawls and suggesting aggressive rate-limiting to be polite to target servers.

crw-crawl