llama.cpp icon
Developer Tools

llama.cpp

🇨🇳 中文 / 🇬🇧 English — 双语介绍
🇨🇳 中文

llama.cpp 是最著名的本地 LLM 推理引擎:纯 C/C++ 实现,资源占用极低,让 Llama、Qwen、DeepSeek 等 GGUF 格式模型在普通 CPU、Mac、树莓派甚至手机上流畅运行,是端侧 AI 与离线推理的事实标准。支持 GPU 加速、量化、OpenAI 兼容服务端,本地 AI 玩家的第一站。 🔗 文章: /post/llama-cpp-guide-2026-complete-tutorial-to-run-llms-on-any-hardware-20260723 | GitHub Stars: 123k+

🇬🇧 English

llama.cpp is the most famous local LLM inference engine: pure C/C++ with minimal resource usage, running GGUF models (Llama, Qwen, DeepSeek) on ordinary CPUs, Macs, Raspberry Pis, even phones — the de-facto standard for on-device and offline inference. GPU acceleration, quantization, and an OpenAI-compatible server make it the first stop for local AI. 🔗 Article: /post/llama-cpp-guide-2026-complete-tutorial-to-run-llms-on-any-hardware-20260723 | GitHub Stars: 123k+

📋 Product Info

Category: Developer Tools
Listed on: 2026-08-07
Last verified: 2026-08-21
Official site: https://github.com/ggml-org/llama.cpp
Open source: GitHub repository ↗
Tags: llm,inference,cpp,cpu,gguf,edge

🎯 Why This Tool

llama.cpp belongs to the Developer Tools category on hedirbase. Tagged with: llm,inference,cpp,cpu,gguf,edge.

llama.cpp is the most famous local LLM inference engine: pure C/C++ with minimal resource usage, running GGUF models (Llama, Qwen, DeepSeek) on ordinary CPUs, Macs, Raspberry Pis, even phones — the de

✓ Manually reviewed ✅ Last verified: 2026-08-21 📁 Open source 🌐 Curated for independents
🌎 访问 llama.cpp → 📦 GitHub