big-data

Installation
SKILL.md

What I do

  • Design and implement big data architectures
  • Process large-scale datasets with distributed systems
  • Optimize data pipelines for throughput
  • Work with Hadoop, Spark, and cloud data platforms
  • Implement real-time streaming data processing
  • Manage data lakes and warehouses at scale

When to use me

Use me when:

  • Working with datasets beyond single-machine capacity
  • Building data pipelines at scale
  • Processing streaming data in real-time
  • Designing data lake architectures
  • Optimizing big data workflows
  • Managing petabyte-scale storage
Installs
6
GitHub Stars
3
First Seen
May 16, 2026