Scraping for Lead Data

When an ICP is defined by something no database has a field for — companies present on a marketplace, running a particular integration, publishing a certain kind of page — the data has to come off the web directly.

Two things decide whether this works: extracting into a schema rather than free text, and staying within limits that keep you unblocked and defensible.

Extract into a schema

The most common failure is scraping page text and trying to parse meaning out of it later. Decide the shape first, then extract into it.