benchmark-checklist

Installation
SKILL.md

Benchmark Checklist

Run this checklist before you report, commit, or act on any measured number: a speedup, a regression, a throughput, a latency, or an eval score. Its purpose is to keep you from measuring the wrong thing and believing it.

When to use

  • you ran a benchmark, profiler, timer, or eval and are about to state a number
  • a decision (merge, revert, optimize further) depends on the measurement
  • a user asks "is it faster?" and a measurement exists or will be taken

When not to use

  • no measurement is involved — do not block prose claims about unmeasured behavior on this checklist; instead label them as guesses

1. Name the limiter

Installs
33
GitHub Stars
40.9K
First Seen
10 days ago