frontierharness-eval

Installation
SKILL.md

FrontierHarness Eval for a Third-Party Harness

Score a harness that is not in the published FrontierHarness v1.0 set, on the same tasks, runtime, and cost accounting, so the result can be placed next to the twelve baseline configurations in results/eval-data.json.

Workspace setup

npx skills add frontier-harness-eval/eval --skill frontierharness-eval installs this skill and its scripts, but not the repository's task definitions or baseline results. Prepare those files before following the evaluation workflow.

Set FH to the absolute path of the scripts/ directory beside the SKILL.md you loaded. Use that installed copy even after changing the working directory; the install location varies by agent and by project/global scope. For example, replace this path with the actual location:

Installs
56
GitHub Stars
258
First Seen
13 days ago
frontierharness-eval — frontier-harness-eval/eval