Bench it

prove-it asks whether the thing works. bench-it asks whether it beats something.

A number on its own is decoration. "37ms" is not a result. "37ms against the 210ms the last release took, same corpus, same machine, n=20" is a result. The second number is the whole job.

Ask before measuring

Never pick the comparison yourself. Ask these two, in order, and wait for answers.

1. Inside or outside?

Bench against ourselves, or against something outside?

2. Which number settles it?