PrivateLM Cross-Platform LLM Client

Skill by ara.so — Devtools Skills collection.

What It Does

PrivateLM is a production-ready Flutter framework for building AI chat applications that seamlessly switch between:

• Local on-device inference — GPU-accelerated GGUF model execution via llama.cpp (Android/iOS)
• Cloud API providers — OpenAI, Anthropic Claude, Google Gemini, Kimi (Moonshot AI)
• Multimodal capabilities — Text and vision support for both local (Qwen2-VL) and cloud models
• Offline-first architecture — All data persisted locally via Hive; no cloud dependency for local mode

Key Features:

• Auto-detects device RAM/GPU and configures optimal inference parameters
• Background service integration with Firebase Cloud Messaging
• Cross-platform (Android full support, iOS via Metal, Web cloud-only)
• Persistent chat sessions and task management