agentic-eval

Installation
SKILL.md

Agentic Evaluation

Use this skill when you are designing or implementing an evaluation loop that lets an agent assess and improve its own outputs through iteration — not when you are running a pre-existing test suite or doing a one-off review with no refinement cycle.

The core pattern is: Generate → Evaluate → Critique → Refine → Output, looping until a convergence condition is met or a max-iteration budget is exhausted.

Use this skill when

  • Implementing a self-critique or reflection loop that feeds output quality back into generation.
  • Building an evaluator-optimizer pipeline that separates generation from evaluation responsibilities.
  • Designing LLM-as-judge scoring to compare or rank multiple candidate outputs.
  • Adding rubric-based scoring with weighted dimensions to iterative generation.
  • Setting iteration limits, convergence checks, or structured evaluation output contracts.
  • The task requires measurable improvement across runs, not just a single-shot best effort.

Do not use this skill when

Installs
5
GitHub Stars
4
First Seen
Sep 1, 2026