Harvard Artifacts ETL Pipeline

Skill by ara.so — Data Skills collection

This skill enables AI coding agents to build end-to-end data engineering pipelines using the Harvard Art Museums API. The project demonstrates ETL operations, SQL analytics, and interactive Streamlit dashboards for artifact collection data.

What This Project Does

The Harvard Artifacts Collection Data Engineering & Analytics App provides:

• API Integration: Fetch artifact data from Harvard Art Museums API with pagination and rate limiting
• ETL Pipeline: Extract, transform, and load artifact metadata, media, and color data into relational databases
• SQL Analytics: Execute predefined analytical queries on structured artifact data
• Interactive Visualization: Streamlit dashboards with Plotly charts for data exploration

The architecture follows: API → ETL → SQL → Analytics → Visualization

Installation