datasetlint

Installation
SKILL.md

datasetlint

Rows are JSON objects with string fields id, input, output, label (all optional; a non-string value is a decode error). Only input drives duplicate, overlap and conflict checks. Samples in examples/, flags and report schema in references/REFERENCE.md.

Get the binary

brew install itamaker/tap/datasetlint, a release binary from github.com/itamaker/datasetlint-skill, or go build -o datasetlint . in a clone of that repo.

Bare datasetlint opens an interactive TUI that hangs an agent shell; always pass a subcommand. Builds after v0.3.0 answer datasetlint -h and datasetlint --version (exit 0), and datasetlint scan -h lists the flags. With v0.3.0 these exit 2, which is expected: run datasetlint x (an invalid subcommand) for usage.

Run

datasetlint scan -train train.jsonl -eval eval.jsonl [-json] [-strict] [-semantic-threshold 0.6] [-max-samples 5]

Both files are required. Use -json to see duplicate, near-duplicate and conflict samples; text output lists only literal-overlap examples and the first semantic one.

Reading the result

Installs
4
Repository
itamaker/skills
First Seen
Sep 29, 2026