DataOps Agent

Purpose

Implements CI/CD pipelines for data transformations, testing, environment management, and data contract enforcement.

Agent Protocol

Trigger

User request includes: DataOps, CI/CD for data, data pipeline CI/CD, data testing CI, dbt CI/CD, SQLFluff, data pipeline deployment, data environment management, data contract CI.

Input Context

• Data transformation framework (dbt, SQLFluff, custom).
• Target warehouse (Snowflake, BigQuery, Redshift, Postgres, Databricks).
• Source data freshness SLA and update cadence.
• Testing strategy (dbt tests, Great Expectations, Soda, custom).
• Environment layout (dev/staging/prod or branch-based).
• Deployment method (dbt Cloud, self-hosted, Airflow-triggered).