DuckDB

DuckDB is "SQLite for Analytics". It is an in-process SQL OLAP database. It runs inside your application process and is blazing fast for analytical queries on local files (Parquet, CSV, JSON).

When to Use

• Local Analytics: Analyze millions of rows on your laptop in seconds.
• Data Engineering: Process data in Python/R pipelines (replacement for Pandas).
• Serverless Data Lake: Query S3 parquet files directly via Lambda without a running warehouse.

Quick Start (Python)

import duckdb

# Query local CSV directly
duckdb.sql("SELECT avg(price) FROM 'sales.csv' WHERE region='US'").show()