int8-inference

Star

Here are 13 public repositories matching this topic...

Language:All

Filter by language

All13 Python8 C#1 C++1 Jupyter Notebook1 Visual Basic .NET1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

anilsathyan7 /Portrait-Segmentation

Star645

Real-time portrait segmentation for mobile devices

android tensorflow keras deeplearning deepstream deeplab jetson-tx2 portrait-matting opencv-dnn mobilenetv2 tensorflow-lite tensorflowjs unet-image-segmentation int8-inference edge-ai portrait-segmentation mediapipe color-harmonization coral-tpu gpu-delegate

UpdatedJan 17, 2021
Jupyter Notebook

BUG1989 /caffe-int8-convert-tools

Star519

Generate a quantization parameter file for ncnn framework int8 inference

caffe ncnn deeplearning-ai quantized-neural-networks int8-inference

UpdatedJul 29, 2020
Python

DerryHub /BEVFormer_tensorrt

Star469

BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).

cuda pytorch quantization int8-inference bevformer tensorrt-plugins

UpdatedNov 20, 2023
Python

jahongir7174 /YOLOv8-qat

Star67

Quantization Aware Training

python pytorch object-detection int8-inference quantization-aware-training int8-quantization yolov8

UpdatedJan 13, 2024
Python

Howell-Yang /onnx2trt

Star18

将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。

python tensorrt calibrator int8-inference int8-quantization

UpdatedAug 17, 2022
Python

whitelok /tensorrt-int8-python-sample

Star14

TensorRT Int8 Python version sample. TensorRT Int8 Python 实现例子。TensorRT Int8 Pythonの例です

python machine-learning ai deep-learning inference nvidia tensorrt int8 int8-inference tensorrt-int8-python

UpdatedJan 28, 2019
Python

ENOT-AutoDL /gpt-j-6B-tensorrt-int8

Star11

GPT-J 6B inference on TensorRT with INT-8 precision

transformers inference quantization tensorrt int8-inference gpt-j gpt-j-6b enot-autodl

UpdatedApr 5, 2023
Python

ENOT-AutoDL /ENOT-transformers

Star7

transformers inference quantization tensorrt int8-inference gpt2 int8-quantization gptj enot-autodl

UpdatedJun 8, 2023

JohnClaw /chatllm.vb

Star4

VB.NET api wrapper for llm-inference chatllm.cpp

bindings api-wrapper llama vb-net vbnet gemma mistral int8 int8-inference int8-quantization cpu-inference chatllm ggml llm-inference qwen

UpdatedNov 26, 2024
Visual Basic .NET

yester31 /TensorRT_ONNX

Star4

Generating tensorrt model using onnx

pytorch quantization tensorrt onnx int8-inference onnxruntime post-training-quantization int8-quantization tensorrt-inference ptq

UpdatedJun 22, 2023
C++

JohnClaw /chatllm.cs

Star3

C# api wrapper for llm-inference chatllm.cpp

csharp inference bindings api-wrapper llama gemma mistral int8 int8-inference int8-quantization cpu-inference llm llms chatllm ggml llm-inference qwen

UpdatedNov 20, 2024
C#

daniel-rychlewski /cnn-planesnet

Star1

Compressed CNNs for airplane classification in satellite images (APoZ-based parameter pruning, INT8 weight quantization)

python deep-learning neural-network tensorflow keras classification image-classification pruning convolutional-neural-networks satellite-imagery quantization epoch kaggle-dataset model-compression tensorflow-gpu planes batch-size tflite neural-network-compression int8-inference

UpdatedJun 10, 2020
Python

akashAD98 /yolov7_vino_with_object_tracking

Star0

it has support for openvino converted model of yolov7-int.xml ,yolov7x,

onnx deepsort openvino int8-inference yolov7

UpdatedMar 6, 2023
Python

Improve this page

Add a description, image, and links to theint8-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with theint8-inference topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly