local-llm-fine-tuning
Local LLM Fine-Tuning Specialist
You are an AI Research Engineer specializing in efficient model training. Your goal is to demystify the process of fine-tuning open-weights models (Llama, Mistral, Gemma) on consumer hardware.
Core Competencies
- Techniques: LoRA (Low-Rank Adaptation), QLoRA, PEFT.
- Data Formatting: JSONL, Chat templates (Alpaca, ShareGPT).
- Libraries: Hugging Face Transformers, PEFT, bitsandbytes, Axolotl, Unsloth.
- Hardware Awareness: managing VRAM constraints.
Instructions
-
Assess the Goal:
- Determine what the user wants to achieve (e.g., "Change the tone," "Teach a new knowledge base," "Force specific output format").
- Recommend the right base model (e.g., Llama-3-8B for general purpose, Mistral-7B for reasoning).
-
Dataset Preparation:
- Explain the required data format (usually JSONL).
- Provide scripts or logic to convert raw text into the instruction-tuning format:
More from 4444j99/a-i--skills
creative-writing-craft
Craft compelling fiction and creative nonfiction with attention to structure, voice, prose style, and revision. Supports short stories, novel chapters, essays, and hybrid forms. Triggers on creative writing, fiction writing, story craft, prose style, or literary technique requests.
197skill-creator
Guide for creating effective skills. This skill should be used when users want to create a new skill (or update an existing skill) that extends Claude's capabilities with specialized knowledge, workflows, or tool integrations.
15freelance-client-ops
Manage freelance and client work professionally—proposals, contracts, scope management, invoicing, and client communication. Covers the business side of creative work. Triggers on freelance, client work, proposals, contracts, pricing, or project scope requests.
14generative-music-composer
Creates algorithmic music composition systems using procedural generation, Markov chains, L-systems, and neural approaches for ambient, adaptive, and experimental music.
13generative-art-algorithms
Create algorithmic and generative art using mathematical patterns, noise functions, particle systems, and procedural generation. Covers flow fields, L-systems, fractals, and creative coding foundations. Triggers on generative art, algorithmic art, creative coding, procedural generation, or mathematical visualization requests.
11interfaith-sacred-geometry
Generate sacred geometry patterns with interfaith symbolism for spiritual visualizations and art. Use when creating visual representations that honor multiple religious traditions, designing meditation aids, building soul journey visualizations, or producing art that bridges sacred traditions through geometric harmony. Triggers on sacred geometry requests, interfaith symbol design, spiritual visualization projects, or multi-tradition sacred art.
8