Skill: trace-grader

Grade an agent's trajectory, not just its output. A run can return the right answer via a bad path (force-pushed, retry-stormed, edited a file it never read) — "corrupt success" — and it can be flaky (passes once, fails on rerun). An answer-only checker is blind to both; TraceGrader inspects the path.

When to use

• You have one or more agent runs (traces) and want to know how the answer was reached, not only whether it was reached.
• You need a repeatability gate: "does this task pass on ALL k reruns?" (pass^k).
• You want a deterministic, CI-gateable signal on tool choice / ordering / retries / step budget — before reaching for an LLM judge.