Docker for Data Environments

When to Use

Load this skill when the user needs to:

• Write or review Dockerfiles for data tools (dbt, Spark, Airflow, Flink, Trino, etc.)
• Optimize Docker layer caching for faster CI/CD builds
• Push/pull images to private registries (ghcr.io, Harbor) with proper tagging
• Build multi-platform images with docker buildx for amd64/arm64
• Stand up a local data stack with Docker Compose (Spark, Airflow, Kafka, MinIO, Postgres)
• Securely pass private PyPI tokens or other secrets at build time with BuildKit
• Harden container images: non-root user, minimal base, read-only filesystem, .dockerignore
• Wire up GitHub Actions CI/CD pipelines that build and push data tool images

Multi-Stage Dockerfiles for Data Tools

dbt Image