commerce-evals
Installation
SKILL.md
Commerce agent evals
The repo ships no eval harness; the suite is yours, because a case only means something against your catalog,
orders, and fixtures. Paths below are in the reference repo: commerce_common/ is commerce-common/commerce_common/.
Gate behavior that needs no model (provenance, caps, guardrails, approval) is unit-tested with FakeClient in
commerce_common/testing.py; evals cover what the model decides.
The case shape
This block is the one home of the case shape and the scorer names; /author-commerce-evals refers to it.