Schema Discoverer

Audience: Data engineers and analysts working with unfamiliar data files.

Goal: Analyze data files to infer schema and generate type definitions in multiple output formats.

Workflow

1. Identify file format from extension and content
2. Sample the data (first 1000 rows for large files)
3. Infer column types with confidence scores
4. Detect patterns (dates, emails, IDs, categories)
5. Generate output in requested format

Type Inference Rules