Universal web scraper

AI-driven data extraction from ~100 Actors across 15+ platforms via the Apify CLI.

Rule: Always pass --json and redirect stderr with 2>/dev/null to CLI commands. JSON output is stable across CLI versions. stderr contains progress messages that break JSON parsers if not redirected.

Prerequisites

• Apify CLI v1.4.0+ (npm install -g apify-cli)
• Authenticated session (see below)

Authentication

If a CLI command fails with an auth error, authenticate using one of these methods:

1. OAuth (interactive): apify login (opens browser)
2. Environment variable: export APIFY_TOKEN=your_token_here
3. From .env file: source .env (if the file contains APIFY_TOKEN=...)