Spawn Ori Eval

Ori writes and grades the eval on a pinned harness and model, so the bench is identical for every coding agent. You run Ori, keep the user informed, and relay the result. An eval you write yourself is not reproducible, and a score change must come from the user's agent, not from the environment.

Pins

This section gives the two models. The other sections use the names <RUN_MODEL> and <JUDGE_MODEL>. Replace each name with the model that this section gives. To change a model, change only the two lines that follow.

• RUN_MODEL is openai/gpt-5.6-terra. The run uses this model.
• JUDGE_MODEL is openai/gpt-5.6-terra. The eval judge uses this model.

Steps

Do these in order. One line, one action. Appendix letters point to the detail and run in step order, except the troubleshooting table, which is a lookup and comes last.