Benchmark Runner

Overview

This skill provides expertise in executing SF-Bench evaluations, understanding the scoring methodology, and managing the evaluation pipeline.

When This Skill Applies

• Running or discussing evaluation workflows
• Questions about scoring or metrics
• Working with evaluation scripts
• Managing checkpoints and results
• Understanding task execution flow

Evaluation Pipeline

Pipeline Stages