Skill: Low-Resource AI Researcher

ID: 215
Category: AI/ML Research
Language: Python
Framework: PyTorch + PEFT (LoRA/QLoRA) + Transformers

Overview

Based on Parameter-Efficient Fine-Tuning (PEFT) technology, trains high-performance medical domain large language models on consumer-grade GPUs or single A100. Supports advanced fine-tuning methods such as LoRA, QLoRA, optimized for medical text understanding and generation tasks.

Features

• 🚀 Parameter-Efficient Fine-Tuning: LoRA, QLoRA, DoRA support
• 🏥 Medical Domain Optimized: Pre-configured for medical QA, diagnosis, clinical notes
• 💻 Low-Resource Ready: Optimized for consumer GPUs (RTX 3090/4090) and single A100
• 📊 Quantization: 4-bit/8-bit quantization with bitsandbytes
• 🔄 Multi-Task: Supports SFT, DPO, and medical instruction tuning
• 📝 Medical Datasets: Built-in support for PubMedQA, MedQA, MIMIC-III