blockchain-data-collection-validation
Installation
SKILL.md
Blockchain Data Collection Validation
Overview
This skill provides a systematic, test-driven workflow for validating blockchain data collection pipelines before production implementation. Use when building POC collectors, validating new data sources, testing DuckDB integration, or verifying complete fetch-to-storage workflows.
Key principle: Validate every component empirically before implementation—connectivity, schema, rate limits, storage, and complete pipeline.
Validation Workflow
This skill follows a 5-step empirical validation workflow:
| Step | Purpose | Output | Success Criteria |
|---|---|---|---|
| 1. Connectivity | Test basic RPC access | Block fetch confirmed | Response <500ms, no errors |
| 2. Schema | Validate all required fields | Field validation report | All fields present, types correct |
| 3. Rate Limits | Find sustainable RPS | Empirical rate (e.g., 5.79 RPS) | 100% success over 50+ blocks |
| 4. Pipeline | Test fetch→DuckDB flow | Complete pipeline working | Data persisted, constraints pass |
| 5. Decision | Document findings | Go/No-Go recommendation | All steps passed, timeline calculated |