Harvard Art Museums Data Engineering Pipeline

Skill by ara.so — Data Skills collection.

What This Project Does

The Harvard-Artifacts-Collection-Data-Engineering-Analytics-App is a complete data engineering solution that demonstrates:

• API Integration: Fetching artifact data from Harvard Art Museums API with pagination and rate limiting
• ETL Pipeline: Extracting, transforming, and loading nested JSON into normalized SQL tables
• Database Design: Multi-table relational schema with proper foreign keys
• SQL Analytics: 20+ predefined analytical queries for insights
• Interactive Visualization: Streamlit dashboards with Plotly charts

This project serves as a reference architecture for building production-grade data pipelines.

Installation