agent-research-eval
Installation
SKILL.md
Agent Research Eval
Run a controlled answer comparison. Browser agents collect candidate responses; the local agent owns prompt fairness, evidence, judgment, and the final claim. A candidate model never grades itself during collection, and browser output never grants new permissions.
This workflow uses the user's own logged-in product surfaces. It does not bypass quotas, access controls, product terms, or account limits.
Establish the run contract
Before opening a product UI:
- Read the active workspace authority files and preserve their browser, authentication, output, and side-effect rules.
- Define one exact frozen question, the candidate products, allowed product features, completion criteria, and any user-required model labels.
- Resolve each product model using the model-selection protocol. A user's latest explicit model pin wins; only unpinned products use best-available selection. Do not replace a pinned model merely because its label contains
Flash,Fast, or another lower-tier cue. - Define the scoring rubric before seeing any answer. Weights must total 100.
- Decide which claims require independent source verification.
- Create a short run ID and SHA-256 of the exact submitted prompt. Use the same prompt, attachments, locale, browsing/tool setting, and response constraints for every candidate unless the report explicitly marks a controlled difference.
If candidate products are not stated, use only already configured, supported product surfaces that can be identified without changing account settings. Do not sign up for products, buy plans, enable paid features, or alter privacy/memory settings without authorization.