knowledge-distill
Knowledge Distill
Phase 4.5 of the inverted pipeline — it sits between knowledge-ingest (Phase 4) and knowledge-compose (Phase 5): plan → curate → fetch → ingest → **distill** → compose → verify → finalize.
Phase 4 deposits one type: source page per fetched URL (verbatim body + pre_extracted_claims:). That makes the wiki a citation store. This phase turns those source claims into the distilled concept/entity web that makes a Karpathy wiki compound across runs: type: concept / type: entity pages that successive runs enrich (new claims appended, source backlinks unioned) rather than duplicate, with claim-level dedup at deposit and per-run re-narration of updated summaries (Step 6.7) so the wiki compounds narratively — the entry-point prose integrates new evidence — as well as structurally. The differentiation thesis's compounding loop + claims-dedup metric become real here.
Optional + fail-soft. A distill failure must NEVER block knowledge-compose. Same posture as the knowledge-curate Step 0.5 coverage pre-step: warn loudly, exit cleanly, let the pipeline continue. The concept/entity pages are an enrichment layer, not a correctness gate.
Read ${CLAUDE_PLUGIN_ROOT}/references/inverted-pipeline.md §"Phase 4.5 — knowledge-distill" once to anchor on the contract.
When to run
<project>/.metadata/ingest-manifest.jsonexists with non-emptyingested[](Phase 4 has run).- User explicitly invokes
/cogni-knowledge:knowledge-distill, or the pipeline reaches Phase 4.5.