LMQL Constraint-Guided Generation

LMQL (Language Model Query Language) from ETH Zurich provides categorical constraint-based generation for LLMs.

Installation

pip install lmql

Core Concepts

LMQL maps to categorical structures:

• Query: Morphism Context → ConstrainedOutput
• Constraints: Subobject classifier restricting output space
• Variables: Typed placeholders forming product types
• Distributions: Probability monad over token sequences