moai-ml-llm-fine-tuning
Installation
SKILL.md
LLM Fine-Tuning Expert
Parameter-Efficient Fine-Tuning (PEFT) for Enterprise LLMs
Focus: LoRA, QLoRA, Domain Adaptation
Models: Llama 3.1, Mistral, Mixtral, Falcon
Stack: PyTorch, Transformers, PEFT, bitsandbytes
Overview
Enterprise-grade fine-tuning strategies for customizing Large Language Models (LLMs) with minimal resource requirements.