Assessing & Generating Business Process Models with BEF4LLM

This skill enables Claude to convert natural-language process descriptions into well-formed BPMN 2.0 XML and to evaluate generated BPMN models using the BEF4LLM framework (Lauer et al., 2026). BEF4LLM defines four orthogonal quality perspectives -- syntactic, pragmatic, semantic, and validity -- each with concrete, scoreable metrics. By internalizing these perspectives, Claude can both produce higher-quality BPMN output and provide structured quality assessments of existing models.

When to Use

• When the user provides a textual process description and asks for a BPMN 2.0 XML model.
• When the user wants to evaluate an existing BPMN XML file for correctness and quality.
• When the user needs to compare two BPMN models (e.g., generated vs. ground truth) on structural and behavioral similarity.
• When the user asks to validate BPMN XML against the BPMN 2.0 XSD schema.
• When the user wants to improve a generated BPMN model by identifying syntactic or semantic defects.
• When building or reviewing a text-to-BPMN pipeline and needs a quality scoring rubric.

Key Technique

BEF4LLM (Business Process Evaluation Framework for LLMs) systematically scores BPMN models across four dimensions rather than relying on ad-hoc or LLM-as-a-judge evaluation. Each dimension captures a different facet of model quality:

1. Validity (1 metric): Binary XSD schema validation of the BPMN XML. This gate determines whether further evaluation is meaningful -- an invalid XML cannot be assessed for syntactic or semantic quality. The paper shows that producing valid BPMN XML is the single hardest challenge for LLMs; many models fail this gate entirely.