Microsoft Open-Sources 1-Bit Inference Framework bitnet.cpp Under MIT

Microsoft has open-sourced bitnet.cpp, its official inference framework for 1.58-bit LLMs whose weights are restricted to three values (-1/0/+1), under the MIT license. Aimed at running large models on CPUs alone without a GPU, official benchmarks show up to 6.17x faster inference and up to 82.2% lower energy use.