#
omniquant
Here is 1 public repository matching this topic...
[EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
benchmarkdeploymenttoolevaluationpruningquantizationpost-training-quantizationawqlarge-language-modelsllmvllmsmoothquantmixtralinternlm2lvlmllama3omniquantquarotlightllmspinquant
- Updated
Mar 13, 2025 - Python
Improve this page
Add a description, image, and links to theomniquant topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with theomniquant topic, visit your repo's landing page and select "manage topics."