agent-ops
Installation
SKILL.md
Agent Operations
Agent Lifecycle
- Instrument —
@opik.track+entrypoint=True+opik.AgentConfig - Configure — Externalize config into
AgentConfig. Opik manages Blueprints with env tags (dev/prod) - Connect —
opik connect --pair <CODE> <startup_cmd>to pair with Opik UI - Evaluate — Evaluation Suites with assertions and execution policies
- Monitor — Dashboards, online evaluation, alerts, guardrails
- Optimize — MaskIDs for config A/B testing, promote winning Blueprints
Config + Retrieval
class AgentConfig(opik.AgentConfig):
model: Annotated[str, "LLM model"]
temperature: Annotated[float, "Sampling temperature"]