eval-harness

Installation
SKILL.md

Eval Harness Skill

A formal evaluation framework for Claude Code sessions, implementing eval-driven development (EDD) principles.

When to Activate

  • Setting up eval-driven development (EDD) for AI-assisted workflows
  • Defining pass/fail criteria for Claude Code task completion
  • Measuring agent reliability with pass@k metrics
  • Creating regression test suites for prompt or agent changes
  • Benchmarking agent performance across model versions
  • Designing a shadow evaluation pipeline to compare a new model against the production champion without user exposure
  • Implementing an LLM-as-judge grader for open-ended outputs where deterministic grading is not feasible
  • Setting up a delayed-label ground-truth pipeline for production ML systems

Philosophy

Installs
2
GitHub Stars
14
First Seen
Apr 7, 2026
eval-harness — marvinrichter/clarc