data-base

Installation
SKILL.md

Mental Model

Data acquisition is converting unstructured web content into structured data. Choose tool based on page complexity: JS-heavy → chrome-devtools MCP, static → Python requests.

Tool Selection

Page Type Tool When to Use
Dynamic (JS-rendered, SPAs) chrome-devtools MCP React/Vue apps, infinite scroll, login gates
Static HTML Python requests Blogs, news sites, simple pages
Complex/reusable logic Python script Multi-step scraping, rate limiting, proxies

Anti-Patterns (NEVER)

  • Don't scrape without checking robots.txt
  • Don't overload servers (default: 1 req/sec)
  • Don't scrape personal data without consent
  • Don't use Chinese characters in output filenames (ASCII only)
  • Don't forget to identify bot with User-Agent
Related skills
Installs
21
GitHub Stars
74
First Seen
Jan 23, 2026