Monitor PDFs - Harvesting & Processing Dashboard

This skill provides a unified dashboard for tracking the diverse data collection and processing jobs required for the S00 Document Type Classifier.

Features

• Harvesting Status: Track Arxiv, MIC (Archive.org/GPO), and Industry sector downloads.
• Batch Processing: Monitor the S00 profile detector running across the 11k+ PDF corpus.
• Vision Data Prep: Track image extraction progress for training the vision classifier.
• Log Aggregation: Quick access to background job logs.

Quick Start

cd .pi/skills/monitor-pdfs

# Show the overall dashboard
./run.sh dashboard