Snapshot Aggregation

Daily compression with merge logic and storage estimation for time-series data.

When to Use This Skill

• Raw event data grows too fast for direct queries
• Need daily snapshots for historical dashboards
• Pipeline runs multiple times per day and needs merge logic
• Want storage estimation for capacity planning

Core Concepts

Raw event data grows fast. Daily snapshots provide:

• Historical dashboards without querying millions of rows
• 90-day retention with minimal storage (~2-3KB/day)
• Multiple pipeline runs per day that merge correctly
• Storage estimation for capacity planning