ptq

Star

Here are 16 public repositories matching this topic...

Language:All

Filter by language

All16 Python11 Jupyter Notebook3 C++2

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

Xilinx /brevitas

Star1.3k

Brevitas: neural network quantization in PyTorch

fpga deep-learning pytorch neural-networks xilinx quantization hardware-acceleration qat brevitas ptq

UpdatedMar 16, 2025
Python

Bobo-y /flexible-yolov5

Star673

More readable and flexible yolov5 with more backbone(gcn, resnet, shufflenet, moblienet, efficientnet, hrnet, swin-transformer, etc) and (cbam，dcn and so on), and tensorrt

sparsity backbone pytorch resnet object-detection gcn tensorrt neck qat shufflenet yolov3 cbam hrnet dcnv2 yolov5 moblienet swin-transformer triton-server ptq

UpdatedAug 19, 2024
Python

Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. This project provides researchers, developers, and engineers advanced quantization and compression tools for deploying state-of-the-art neural networks.

machine-learning deep-neural-networks deep-learning neural-network tensorflow optimizer pytorch quantization qat network-quantization network-compression edge-ai ptq

UpdatedMar 17, 2025
Python

TsingmaoAI /MI-optimize

Star21

mi-optimize is a versatile tool designed for the quantization and evaluation of large language models (LLMs). The library's seamless integration of various quantization methods and evaluation techniques empowers users to customize their approaches according to specific requirements and constraints, providing a high level of flexibility.

benchmark inference quantization qat ptq llm large-language-model

UpdatedNov 28, 2024
Python

MAGICS-LAB /OutEffHop

Star21

[ICML 2024] Outlier-Efficient Hopfield Layers for Large Transformer-Based Models

transformer outliers attention attention-mechanism outlier-removal outlier hopfield-neural-network ptq outlier-treatment modern-hopfield-networks modern-hopfield-model icml-2024 softmax-1 quantized-friendly no-op-outlier

UpdatedOct 17, 2024
Python

yester31 /TensorRT_API

Star16

Deep Learning Model Optimization Using by TensorRT API, window

cuda pytorch vgg resnet quantization unet tensorrt yolov5 detr ptq yolov6

UpdatedAug 29, 2022
Python

lix19937 /tensorrt-insight

Star15

Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda

nvidia asp tensorrt qat ptq

UpdatedMar 15, 2025
C++

yester31 /Quantization_EX

Star6

quantization example for pqt & qat

quantization tensorrt int8 qat model-optimization quantization-aware-training post-training-quantization pytorch-quantization ptq

UpdatedJul 24, 2023
Python

smpanaro /norm-tweaking

Star5

Post post-training-quantization (PTQ) method for improving LLMs. Unofficial implementation ofhttps://arxiv.org/abs/2309.02784

quantization post-training-quantization ptq llms

UpdatedFeb 21, 2024
Python

yester31 /TensorRT_Sparse

Star4

inference with the structured sparsity and quantization

quantization tensorrt structured-sparsity sparsity-pattern ptq sparse-tensor-cores sparse-int8-model accelerate-the-inference

UpdatedAug 30, 2023
Python

yester31 /TensorRT_ONNX

Star4

Generating tensorrt model using onnx

pytorch quantization tensorrt onnx int8-inference onnxruntime post-training-quantization int8-quantization tensorrt-inference ptq

UpdatedJun 22, 2023
C++

BlindOver /blindover_AI

Star2

Build AI model to classify beverages for blind individuals

ai deep-learning mobile-app pytorch classification resnet quantization qat shufflenetv2 mobilenetv3 efficientnet ptq

UpdatedAug 16, 2023
Python

OmidGhadami95 /EfficientNetV2_Quantization_CK

Star1

EfficientNetV2 (Efficientnetv2-b2) and quantization int8 and fp32 (QAT and PTQ) on CK+ dataset . fine-tuning, augmentation, solving imbalanced dataset, etc.