Dedupe Against Corpus

Table of Contents

• Three tiers of match
• Workflow
• Worked example
• Guardrails

Related skills: Called by ingest-inbox-item step 4. Queried ad-hoc by search-corpus. Backlinks into matched seeds (the one place this skill writes outside new seeds).

Three tiers of match

1. Tier 1 — Exact fingerprint: sha256 of body matches an existing seed's fingerprint. → SKIPPED.
2. Tier 2 — Title similarity: normalized Jaccard on title tokens ≥ 0.7. → LINK candidate.
3. Tier 3 — Content similarity: for seeds sharing ≥2 topic tags, first-200-word Jaccard ≥ 0.5. → LINK candidate.

Tier 2 and 3 candidates are unioned (up to 3 total LINK targets).