verifier-evaluations

Installation
SKILL.md

Verifier Evaluations

A verifier decides a benchmark's mathematical predicate from frozen input and a bounded submission. It does not grade prose, confidence, tool use, or equality with one preferred solution. Use harbor-benchmarks only when the task also needs Harbor packaging, environment changes, or execution guidance.

Establish the contract

Choose the smallest checkable submission: a typed result, a result with a necessary finite witness, or a supported formal proof. Accept mathematically equivalent representations unless canonicalization is an explicit task outcome. The visible instruction and schema must describe every enforced condition and must not leak the solution or derived conclusions.

Installs
1
GitHub Stars
326
First Seen
Oct 26, 2026