Dataset Curator

This skill ensures that the data you feed to your AI is clean, accurate, and safe.

Capabilities

1. Data Cleaning & Structuring

• Removes duplicates, boilerplate, and noisy text from knowledge bases.
• Converts unstructured documents into clean Markdown or JSON/Vector-friendly formats.

2. Privacy Audit

• Scans datasets for PII (Personal Identifiable Information) before they are sent to LLMs or vector databases.

Usage

• "Clean up the knowledge/ directory and structure it for better RAG performance."
• "Audit this customer feedback dataset for sensitive info before we use it for AI training."