KoboldCpp 是轻量本地大模型推理程序,专注 GGUF 格式模型一键运行,提供 OpenAI 兼容接口与故事写作友好界面,内存占用低,适合普通电脑跑本地模型。 🔗 GitHub: https://github.com/LostRuins/koboldcpp | Stars: 11k+
KoboldCpp is a lightweight local LLM inference program focused on one-click GGUF model running. OpenAI-compatible endpoints, story-writing-friendly UI, low memory — great for local models on regular PCs. 🔗 GitHub: https://github.com/LostRuins/koboldcpp | Stars: 11k+
KoboldCpp belongs to the Developer Tools category on hedirbase. Tagged with: local,LLM,inference,GGUF,open-source.
KoboldCpp is a lightweight local LLM inference program focused on one-click GGUF model running. OpenAI-compatible endpoints, story-writing-friendly UI, low memory — great for local models on regular P