Extraction Pipeline Patterns

Format detection → extractor routing → post-processing, across 106 formats / 140 file extensions

The full-registry counts are verified against published claims by scripts/sync_supported_counts.py verify. Runtime SUPPORTED_FORMAT_COUNT and SUPPORTED_EXTENSION_COUNT values are derived from the full static FORMATS registry.

Layout

• crates/xberg/src/core/pipeline/ — orchestration (mod.rs, cache.rs, execution.rs, features.rs, format.rs, initialization.rs, page_markers.rs)
• crates/xberg/src/core/mime.rs, core/formats.rs — detection and the FORMATS registry
• crates/xberg/src/extractors/ — one module per format, each implementing InternalDocumentExtractor
• crates/xberg/src/extraction/ — shared parsing/rendering helpers used by those extractors
• crates/xberg/src/core/config/, core/config_validation/ — both directories, not files

Flow