AI Observability and Debugging

Acknowledgement: Shared by Peter Bamuhigire, techguypeter.com, +256 784 464178.

Use When

• A support ticket arrives saying "this answer is wrong" and you need to pull up the exact prompt, model, retrieval state, and reasoning in < 2 minutes.
• Building the AI tracing schema (OTel + custom attributes) so every request can be replayed and explained.
• Wiring debugging surfaces in the back-office and (for some products) tenant-facing "show me why".
• Diagnosing a latency or cost regression with the per-stage breakdown.

Do Not Use When

• The task is generic platform observability — observability-monitoring.
• The task is the eval harness — ai-eval-harness.
• The task is the audit log as compliance record — that's a separate lens (ai-on-saas-architecture §5).

Required Inputs