LM Studio Subagents

Overview

Offload LLM tasks to local models running in LM Studio to save API costs and maintain privacy. LM Studio provides a native REST API and OpenAI-compatible endpoints. Prefer the native /api/v1/chat API for long-form work because it exposes output-token, reasoning, context-length, streaming, and stateful-continuation controls. Use local models for high-volume, lower-complexity tasks like summarization, extraction, classification, and reformatting while reserving cloud APIs for complex reasoning.

Instructions

When a user wants to use local models via LM Studio, determine the task:

Task A: Set up LM Studio as a local API server

1. Download and install LM Studio from https://lmstudio.ai/
2. Download a model through the LM Studio UI (recommended starting models):
   • lmstudio-community/Llama-3.1-8B-Instruct-GGUF (general purpose)
   • lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF (fast inference)
   • lmstudio-community/Qwen2.5-7B-Instruct-GGUF (multilingual)