local-model-ops
Installation
SKILL.md
Local model ops
Wiring a local GGUF served by LM Studio into Hermes. Runtime-dependent details come from inspected installations; recheck them after upgrades. Historical measurements are examples, not guarantees for another model or machine.
Why run local at all
Choose local or hosted by measured quality, speed, budget and privacy needs. Local inference can provide:
| Reason | What it gets you |
|---|---|
| Model choice | Choose models suited to adult, red-team or dark-fiction work; behavior still depends on the model and harness |
| Local inference | Prompts stay local only when auxiliaries, fallback routes and tools are also local or disabled |
| No hosted inference quota | Offline inference after setup; local servers can still reject overloaded requests |
Compare hosted options in token-efficiency; do not assume either route is cheaper or faster.