Harvard Art Museums Data Engineering & Analytics

Skill by ara.so — Data Skills collection.

This project demonstrates a complete data engineering workflow: extracting data from the Harvard Art Museums API, transforming it into relational tables, loading into SQL databases, and building interactive analytics dashboards with Streamlit.

What This Project Does

• API Integration: Fetches artifact data from Harvard Art Museums API with pagination and rate limiting
• ETL Pipeline: Transforms nested JSON into structured relational tables (metadata, media, colors)
• SQL Storage: Loads data into MySQL/TiDB Cloud with proper schema design
• Analytics: Executes 20+ predefined analytical queries
• Visualization: Interactive Plotly dashboards for data exploration

Installation