local-llm

Installation
SKILL.md

Local LLM Setup (LM Studio + mlx-dspark)

Announce at start

"I'm using the local-llm skill to work with the local inference setup."

Architecture

Two local LLM backends exist on this machine, serving the same underlying model family (Qwen3.8-27B, 4-bit, hybrid attention -- see RAM cheatsheet below):

Backend Port Role Managed by
LM Studio 1234 Interactive chat UI use only LM Studio app itself (own TTL-based auto-unload)
mlx-dspark 8090 Production -- everything build_local.py and any script under systems/superintelligence/* talks to launchd (~/Library/LaunchAgents/com.local.mlx-dspark.plist)
Installs
1
GitHub Stars
628
First Seen
1 day ago