Guidance Grammar-Constrained Generation

Microsoft's Guidance library for grammar-constrained LLM generation with categorical structure.

Installation

pip install guidance

Core Concepts

Guidance maps to categorical structures:

• Grammar: Regular/context-free language as object
• Generation: Morphism Grammar → TokenSequence
• Composition: Sequential grammar combination
• Select: Coproduct (sum type) over alternatives
• Capture: Named binding creating product type