vaex
Vaex
Vaex is a hidden gem. It uses Memory Mapping to open 100GB files instantly on a laptop and visualize them.
When to Use
- Visualization: Plotting 1 billion points via heatmaps.
- Instant Opening: No "loading" time for HDF5/Arrow files.
- String Processing: Very fast string operations.
Core Concepts
Out-of-Core
Data stays on disk. Virtual columns are computed on the fly.
Binning
Aggregating data into a grid for visualization (heatmap) rather than plotting individual points.
More from g1joshi/agent-skills
template
Expert [skill-name] assistance covering [feature 1], [feature 2], and [feature 3]. Use when [working with X], [debugging Y], or [implementing Z].
34mariadb
MariaDB MySQL-compatible database with Galera clustering. Use for MySQL-compatible database needs.
6claude
Anthropic Claude AI models for analysis and coding. Use for AI assistants.
5javascript
JavaScript ES6+ programming including async/await, DOM manipulation, modules, and Node.js. Use for .js files and web development.
4typescript
TypeScript static typing with interfaces, generics, decorators, and type inference. Use for .ts files.
4python
Python programming with type hints, async/await, decorators, and package management. Use for .py files and data science.
4