Using MLX for LLMs on Apple Silicon

MLX-LM is a Python package for running large language models on Apple Silicon, leveraging the MLX framework for optimized performance with unified memory architecture.

Table of Contents

• Core Concepts
• Installation
• Text Generation
• Interactive Chat
• Model Conversion
• Quantization
• Fine-tuning with LoRA
• Serving Models
• Best Practices
• References

Core Concepts