MLOps DAG Builder

Design and implement DAG-based ML pipeline architectures using production orchestration tools.

Overview

This skill provides guidance for building platform-agnostic MLOps pipelines using DAG orchestrators (Airflow, Dagster, Kubeflow, Prefect). It focuses on workflow architecture, not SpecWeave integration.

When to use this skill vs ml-pipeline-orchestrator:

• Use this skill: General MLOps architecture, Airflow/Dagster DAGs, cloud ML platforms
• Use ml-pipeline-orchestrator: SpecWeave increment-based ML development with experiment tracking

When to Use This Skill

• Designing DAG-based workflow orchestration (Airflow, Dagster, Kubeflow)
• Implementing platform-agnostic ML pipeline patterns
• Setting up CI/CD automation for ML training jobs
• Creating reusable pipeline templates for teams
• Integrating with cloud ML services (SageMaker, Vertex AI, Azure ML)