GenAIOps

WHEN: Designing or operating production GenAI systems with release gates, prompt/model versioning, evaluation automation, observability, drift monitoring, rollback, and governance.

When to Use

• Defining how prompts, models, and tools move from dev to production
• Setting blocking evaluation gates before promotion
• Designing LLM observability, tracing, and runtime dashboards
• Managing prompt/model rollout, canarying, rollback, and baseline updates
• Coordinating feedback loops, drift detection, and issue remediation

Decision Tree