agent-ops
Agent Operations
Agent Lifecycle
- Instrument —
@opik.track+entrypoint=True+opik.AgentConfig - Configure — Externalize config into
AgentConfig. Opik manages Blueprints with env tags (dev/prod) - Connect —
opik connect --pair <CODE> <startup_cmd>to pair with Opik UI - Evaluate — Evaluation Suites with assertions and execution policies
- Monitor — Dashboards, online evaluation, alerts, guardrails
- Optimize — MaskIDs for config A/B testing, promote winning Blueprints
Config + Retrieval
class AgentConfig(opik.AgentConfig):
model: Annotated[str, "LLM model"]
temperature: Annotated[float, "Sampling temperature"]
client = opik.Opik()
More from comet-ml/opik-skills
opik
Opik observability for LLM agents — Agent Configuration, Local Runner (opik connect), Test Suites, threads, integrations. Use for "configure my agent", "connect my agent", "evaluate my agent" or "integrate with Opik".
168instrument
Add Opik tracing to an existing codebase. Detects language (Python/TypeScript), identifies LLM frameworks, adds appropriate decorators and integrations, marks entrypoints, and wires up environment config. Use for "instrument my code", "add opik tracing", "add observability", or "trace my agent".
152agent-config
Opik Agent Configuration — Blueprints, get_agent_config() with selectors, environment tags, Prompt/ChatPrompt fields, deploy_to(), MaskIDs, and config lifecycle.
5opik-connect
Opik Connect (Local Runner) — pair your local agent with the Opik browser UI for Python and TypeScript.
5instrument-typescript
Adding Opik observability to TypeScript/JS LLM apps — track() with entrypoint and explicit params for Local Runner, framework integrations.
5evaluation-suites
Opik Evaluation Suites — assertions, execution policies, CI integration. Replaces old Datasets API.
5