DSPy Evaluation Suite

Goal

Systematically evaluate DSPy programs using built-in and custom metrics with parallel execution.

When to Use

• Measuring program performance before/after optimization
• Comparing different program variants
• Establishing baselines
• Validating production readiness

Related Skills

• Use with any optimizer: dspy-bootstrap-fewshot, dspy-miprov2-optimizer, dspy-gepa-reflective
• Evaluate RAG pipelines: dspy-rag-pipeline

Inputs