data-pipeline
Data Pipeline
4-stage V2 charity evaluation pipeline with 100-point scoring.
Philosophy: Capture broadly, filter later. Correctness > cost, but we can have both.
Quick Reference (V2 Pipeline)
| Stage | Entry Point | What It Does |
|---|---|---|
| 1. Crawl | crawl.py |
Collect data from 5 sources |
| 2. Process Data | process_data.py |
Derive fields + reconcile sources |
| 3. Process Baseline | process_baseline.py |
Generate baseline narratives + export + verify |
| 4. Process Rich | process_rich.py |
Generate rich narratives + export + verify |
Wrapper: ./run_v2.sh runs all 4 stages
More from uabbasi/good-measure-giving
frontend-design
Create distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, artifacts, posters, or applications (examples include websites, landing pages, dashboards, React components, HTML/CSS layouts, or when styling/beautifying any web UI). Generates creative, polished code and UI design that avoids generic AI aesthetics.
11form990-expert
Deep expertise on IRS Form 990 structure, fields, and nonprofit financial analysis. Activates when working on Form 990 parsing, ProPublica API integration, or charity financial evaluation code.
1zakat-fiqh
Islamic jurisprudence expertise on zakat - the 8 categories of recipients (asnaf), scholarly interpretations across madhabs, and how to assess charity alignment with zakat eligibility. Activates when working on zakat classification, wallet tags, or donor guidance.
1webapp-testing
Test web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing screenshots, and viewing browser logs. Use when testing the website or debugging UI issues.
1llm-prompting
Expert guidance on LLM prompting patterns used in this project. Covers versioned prompts, schema enforcement, category calibration, multi-provider fallback, and narrative generation. Activates when working on prompts, LLM integration, or evaluation logic.
1analytics
Unified analytics (Cloudflare + Firestore + GA4). Pull traffic data, user activity, feature adoption, and giving metrics. Use when checking site performance, user behavior, or feature usage.
1