benchmark-onboarder
Installation
SKILL.md
HELM Benchmark Onboarder
Transform creativity benchmark datasets into HELM Scenario implementations.
Core Principles
- Dataset-first - The dataset defines what's possible; the paper provides context
- Skip model outputs - We want original prompts/stimuli, not what GPT-4 generated
- Verify everything - Every field must map to real data