unicode-consistency
Installation
SKILL.md
Unicode Consistency
Audit and remediate Unicode issues in text columns.
When to invoke
- User suspects "weird characters" in the data.
- Search / joins on text keys return inconsistent results (usually a normalisation or invisible-char issue).
- Dataset came from multiple sources with different encodings / input methods.
- Preparing text for embedding (see
vector-upsert) or search indexing.