datasetlint
datasetlint
Rows are JSON objects with string fields id, input, output, label (all optional; a non-string value is a decode error). Only input drives duplicate, overlap and conflict checks. Samples in examples/, flags and report schema in references/REFERENCE.md.
Get the binary
brew install itamaker/tap/datasetlint, a release binary from github.com/itamaker/datasetlint-skill, or go build -o datasetlint . in a clone of that repo.
Bare datasetlint opens an interactive TUI that hangs an agent shell; always pass a subcommand. Builds after v0.3.0 answer datasetlint -h and datasetlint --version (exit 0), and datasetlint scan -h lists the flags. With v0.3.0 these exit 2, which is expected: run datasetlint x (an invalid subcommand) for usage.
Run
datasetlint scan -train train.jsonl -eval eval.jsonl [-json] [-strict] [-semantic-threshold 0.6] [-max-samples 5]
Both files are required. Use -json to see duplicate, near-duplicate and conflict samples; text output lists only literal-overlap examples and the first semantic one.