heretic-abliteration
Installation
SKILL.md
Heretic — Abliteration + Ollama Serving
Remove refusals from open-weight LLMs with p-e-w/heretic,
then serve the result locally through the Ollama CLI. Heretic combines directional
ablation ("abliteration") with an Optuna/TPE search that co-minimizes refusals and
KL divergence — decensoring the model while preserving its intelligence, no
fine-tuning required.
The one architectural fact: Ollama can't be Heretic's backend. Heretic edits raw HF weights and reads activations (PyTorch/transformers); Ollama is inference-only over GGUF. The link is downstream: Heretic → GGUF → Ollama. See references/troubleshooting.md.
Quick Start — pick your path
Path A — Serve now, zero compute (recommended on Apple Silicon / no GPU):
./scripts/ollama-pull-abliterated.sh huihui_ai/llama3.2-abliterate:3b