llama-cpp
Installation
SKILL.md
llama.cpp -- C/C++ LLM Inference Framework Guide
Official Documentation
| Source | URL |
|---|---|
| GitHub Repository | https://github.com/ggml-org/llama.cpp |
| C API Header (llama.h) | https://github.com/ggml-org/llama.cpp/blob/master/include/llama.h |
| C++ RAII Wrappers | https://github.com/ggml-org/llama.cpp/blob/master/include/llama-cpp.h |
| Build Instructions | https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md |
| Server Documentation | https://github.com/ggml-org/llama.cpp/blob/master/tools/server/README.md |
| Quantization Tool | https://github.com/ggml-org/llama.cpp/blob/master/tools/quantize/README.md |
| GGUF Specification | https://github.com/ggml-org/ggml/blob/master/docs/gguf.md |
| Function Calling Docs | https://github.com/ggml-org/llama.cpp/blob/master/docs/function-calling.md |
| Multimodal Docs | https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md |
| Examples Directory | https://github.com/ggml-org/llama.cpp/tree/master/examples |
| HuggingFace GGUF Hub | https://huggingface.co/docs/hub/gguf-llamacpp |
| Llama-Unreal Plugin | https://github.com/getnamo/Llama-Unreal |