Agent Operations: Build, Evaluate, and Monitor AI Agents

This skill covers the agent lifecycle beyond basic tracing: architecture patterns, evaluation, metrics, and production monitoring. All examples use Opik for observability — for SDK details (tracing, integrations, span types), load the opik skill.

The Agent Lifecycle

1. Instrument — Add Opik tracing to make your agent's behavior visible (see opik skill)
2. Evaluate — Measure performance with datasets, metrics, and experiments
3. Monitor — Track quality, cost, and reliability in production
4. Optimize — Improve based on data from evaluation and production traces

Agent Architecture Patterns

Trace every component of your agent with appropriate span types:

import opik