BREAKING
Microsoft open-sources bitnet.cpp
0
x
x86 speedup
0
%
energy saved x86
0
x
ARM speedup
0
B
parameters
0
tok/s
reading speed
Ternary weights: -1, 0, +1
Strengths vs limitations
Strengths
●
No GPU needed
●
Great energy efficiency
●
Edge and local AI
Limitations
●
Few native 1.58-bit models
●
Build setup is hard
●
CLI-centric, immature API
CPU first, GPU and NPU next
AI NEWS BLITZ
Microsoft has released bitnet.cpp, a 1-bit inference engine that runs on CPUs without a GPU.