generated fromThe-Pocket/PocketFlow-Template-Python
- Notifications
You must be signed in to change notification settings - Fork1.2k
-
bitnet.cpp is the official inference framework for 1-bit LLMs (e.g., BitNet b1.58). It offers a suite of optimized kernels, that support fast and lossless inference of 1.58-bit models. Original repository:https://github.com/microsoft/BitNet Check it out here:https://github.com/viraatdas/BitNet-Tutorial |
BetaWas this translation helpful?Give feedback.
All reactions
Replies: 0 comments
Sign up for freeto join this conversation on GitHub. Already have an account?Sign in to comment