Harvard Artifacts ETL Pipeline

Skill by ara.so — Data Skills collection.

This skill enables AI coding agents to help developers build end-to-end data engineering pipelines using the Harvard Art Museums API. The project demonstrates real-world ETL patterns, SQL database design, analytical queries, and interactive visualization using Streamlit.

What This Project Does

The Harvard Artifacts Collection application:

• Fetches artifact data from Harvard Art Museums API with pagination
• Transforms nested JSON into relational database tables
• Loads data into MySQL/TiDB Cloud databases
• Executes analytical SQL queries on artifact metadata, media, and colors
• Visualizes results through interactive Plotly charts in Streamlit

Architecture: API → ETL → SQL → Analytics → Visualization

Installation