Hugging Face · AI

Run Local Models in Pi: llama.cpp, GGUF, and the /llama Command

Run local models in Pi with llama.cpp — fully private, offline, and with no per-token cost. In this tutorial I show you how to install llama.cpp, pick the right GGUF model and quantization for your hardware using Hugging Face's hardware compatibility feature, and download, load, and use the model directly from Pi with the `/llama` command. By the end you'll have Qwen3 8B running locally as a coding agent, with no prompts, code, or data ever leavi

Introductie van de bron.