roofline-capacity
Installation
SKILL.md
Capacity and rollout
Every task below runs as task -t ${CLAUDE_SKILL_DIR}/../roofline-toolbox/Taskfile.yml <task>, or include that Taskfile in the project one (task infer:<task>). INFER_URL and INFER_PROFILE come from the environment, from arguments (task serve INFER_PROFILE=x) or from inference.env in the current directory.
Inputs
Without these the estimate is invalid; when a value is missing, write "unknown" and ask for a measurement.
| Parameter | Source | Typical for coding agents |
|---|---|---|
| Concurrent users | clients, proxy | 5-50 per team |
| Prompt length (p50, p95) | task metrics prompt tokens, proxy logs |
10k-60k, system prompt is stable |
| Response length | same place | 200-2000 tokens, more with thinking |
| Requests per user action | client | an agent makes 5-30 calls per task |
| SLO | agreed with the team | TTFT p95 2 s, TPOT p95 50 ms |
| Model and quality | evals, smoke-toolcall | the smallest model that passes evals |
| GPU | task gpu |
type, count, NVLink between them |