Web Fetch

Controls a headless Chrome instance via Chrome DevTools Protocol (CDP) to fetch web pages with full JavaScript rendering. Handles JS redirects, SPAs, and dynamic content. Extracts clean text from any URL.

Prerequisites

• Google Chrome or Chromium: Must be installed on the system.
  • macOS: brew install --cask google-chrome
  • Ubuntu/Debian: sudo apt install google-chrome-stable
  • Windows: winget install Google.Chrome
• Python 3: Standard library only. Zero pip dependencies. Optionally trafilatura for better content extraction.
• No API keys or tokens required.

Usage

Single URL