Apache Airflow Skill

Master Apache Airflow for workflow orchestration, data pipeline automation, and scheduled task management. This skill covers DAG authoring, operators, sensors, hooks, XComs, variables, connections, and deployment patterns.

When to Use This Skill

USE when:

• Building complex data pipelines with task dependencies
• Orchestrating ETL/ELT workflows
• Scheduling recurring batch jobs
• Managing workflows with retries and error handling
• Coordinating tasks across multiple systems
• Need visibility into workflow execution history
• Requiring audit trails and lineage tracking
• Building ML pipeline orchestration