Capturing paginated JSON from an authenticated research UI

Drive the user's logged-in browser over CDP, hook XMLHttpRequest, click through the result pages, and keep the JSON the page already received. No direct API calls, no credential handling, no fighting the export cap.

Decide the access route BEFORE touching anything

Systematic capture of a paid research corpus is the user's decision to make knowingly, not yours to slide into. Surface the trade-off once, in plain terms, then do what they decide.

LexisNexis, Bloomberg and Thomson Reuters terms prohibit systematic downloading; the export row cap is that prohibition's enforcement mechanism, and paging the XHR endpoint routes around it. The exposure — account termination, an institutional licence, a research programme — lands on the user, not on you.