Token Saver Memory Dedup

Deduplicates memory records against existing memory files to prevent duplicate entries.

Purpose

This skill provides the deduplicateAgainstMemory function that filters out memory records that already exist in the memory system:

• Compares incoming records against patterns.json and gotchas.json
• Case-insensitive matching for deduplication
• Returns statistics about total, kept, and filtered records
• Handles corrupt or missing memory files gracefully

Usage

const { deduplicateAgainstMemory } = require('./scripts/main.cjs');