Phoenix - AI Observability Platform

Collaborating skills

• AI Engineering: skill: ai-engineering for building the LLM applications that Phoenix observes

Open-source AI observability and evaluation platform for LLM applications with tracing, evaluation, datasets, experiments, and real-time monitoring.

When to Use Phoenix

• Debugging LLM applications with detailed traces and span analysis
• Running systematic evaluations on datasets with LLM-as-judge
• Monitoring production LLM systems with real-time insights
• Building experiment pipelines for prompt/model comparison
• Self-hosted observability without vendor lock-in

Key Features

• Tracing: OpenTelemetry-based trace collection for any LLM framework