slop-test-detector
Installation
SKILL.md
Slop Test Detector
Agents generate tests that compile, pass, and increase coverage — but catch zero bugs. This skill detects those patterns programmatically.
When to use: Auditing existing test files for quality. Validating generated tests before writing them to disk. Enforcing the // Defect: comment convention.
When not to use: Evaluating test strategy (what to test). Measuring code coverage. Reviewing production code quality.
Rationalizations (Do Not Skip)
| Rationalization | Why It's Wrong | Required Action |
|---|---|---|
| "It compiles and passes" | Slop tests always pass — that's the problem | Run analyzeTestFile() and check must-fail findings |
| "It has a Defect comment" | Comment can be trivial or copied from the test name | Check trivial_defect_comment findings |
| "It has assert.ok(result)" | Truthiness checks pass for any non-null value | Verify assert.equal/deepEqual on specific values |
| "It increases coverage" | Coverage counts lines executed, not bugs caught | Check that assertions verify behavior, not just reachability |