Inference toolbox

Every task is idempotent, prints a short table and exits non-zero on failure. Run from the project directory, so inference.env and .inference-state/ stay with the project.

task -t ${CLAUDE_SKILL_DIR}/Taskfile.yml health
task -t ${CLAUDE_SKILL_DIR}/Taskfile.yml serve INFER_PROFILE=qwen3-32b-fp8-vllm

Without go-task, call the scripts directly with the same environment variables: ${CLAUDE_SKILL_DIR}/scripts/health.sh, python3 -I ${CLAUDE_SKILL_DIR}/scripts/bench.py --n 16 --concurrency 4.

Tasks