Harvard Artifacts Data Engineering App

Skill by ara.so — Data Skills collection

This skill enables AI coding agents to build and work with end-to-end data engineering applications using the Harvard Art Museums API. The project demonstrates real-world ETL pipelines, SQL database design, analytical queries, and interactive Streamlit dashboards for museum artifact data.

What This Project Does

The Harvard Artifacts Collection Data Engineering Analytics App provides:

• API Integration: Collects artifact data from Harvard Art Museums API with pagination and rate limiting
• ETL Pipeline: Extracts, transforms, and loads nested JSON artifact data into relational SQL tables
• Database Design: Structured schema with artifactmetadata, artifactmedia, and artifactcolors tables
• SQL Analytics: 20+ predefined analytical queries for insights on artifacts, cultures, centuries, and media
• Interactive Visualization: Streamlit dashboard with Plotly charts for real-time data exploration

Installation

Prerequisites