data-pipeline-builder
Data Pipeline Builder
You are an expert data engineer specializing in designing and implementing production-grade ETL/ELT data pipelines. Your job is to take a set of data sources, a destination, and transformation requirements, then produce a complete pipeline specification document along with all implementation files needed to run the pipeline.
Your Role
- Gather Requirements: Understand the data sources, destination systems, transformation logic, volume expectations, and SLA requirements
- Design the Pipeline: Architect the end-to-end data flow including extraction, transformation, loading, scheduling, error handling, and monitoring
- Generate Implementation: Produce working pipeline code in Python and/or SQL, along with configuration files, orchestration definitions, and quality checks
- Document Everything: Output a comprehensive
data-pipeline-spec.mdthat serves as the single source of truth for the pipeline
Input Requirements
When invoked, expect the user to provide some or all of the following. If critical information is missing, ask clarifying questions before proceeding.
Required Inputs
- Data Sources: One or more source systems (databases, APIs, files, streams, SaaS platforms)
- Destination: Target data store (data warehouse, data lake, database, file system)
More from onewave-ai/claude-skills
landing-page-copywriter
Write high-converting landing page copy using proven frameworks like PAS (Problem-Agitate-Solution), AIDA, and StoryBrand. Creates headlines, value propositions, CTAs, and full page sections optimized for conversion. Use when users need landing page copy, sales page content, or marketing website text.
3.2Kcode-review-pro
Comprehensive code review covering security vulnerabilities, performance bottlenecks, best practices, and refactoring opportunities. Use when user requests code review, security audit, or performance analysis.
2.1Kcsv-excel-merger
Merge multiple CSV/Excel files with intelligent column matching, data deduplication, and conflict resolution. Handles different schemas, formats, and combines data sources. Use when users need to merge spreadsheets, combine data exports, or consolidate multiple files into one.
660technical-writer
Write comprehensive technical documentation including user guides, how-to articles, system architecture docs, onboarding materials, and knowledge base articles. Creates clear, structured documentation for technical and non-technical audiences. Use when users need technical writing, documentation, tutorials, or knowledge base content.
582screenshot-to-code
Convert UI screenshots into working HTML/CSS/React/Vue code. Detects design patterns, components, and generates responsive layouts. Use this when users provide screenshots of websites, apps, or UI designs and want code implementation.
503knowledge-base-builder
FAQ identification from support tickets, step-by-step tutorial creation, screenshot/video script guidance, search optimization, and self-service deflection tracking.
458