BitNet
微软开源的 1-bit LLM 推理框架，配合自研的 bitnet.cpp 在 CPU 上运行三值权重（-1/0/1）模型，把显存与能耗压到常规推理的零头，让大模型能在笔记本甚至单板设备上跑起来。仓库附带量化与评测工具链。 ⭐ GitHub Stars: 41k+ | 🔗 仓库: https://github.com/microsoft/BitNet
Microsoft's official inference framework for 1-bit LLMs. Together with bitnet.cpp it runs ternary-weight (-1/0/1) models on CPUs, cutting memory and energy use to a fraction of standard inference so large models fit on laptops and single-board machines. Ships with quantization and evaluation tooling. ⭐ GitHub Stars: 41k+ | 🔗 Repo: https://github.com/microsoft/BitNet
📋 Product Info
🎯 Why This Tool
BitNet belongs to the Open Source LLMs category on hedirbase. Tagged with: 1-bit-llm,inference,cpu,microsoft,quantization,open-source.
Microsoft's official inference framework for 1-bit LLMs. Together with bitnet.cpp it runs ternary-weight (-1/0/1) models on CPUs, cutting memory and energy use to a fraction of standard inference so l