Movatterモバイル変換

Skip to content

#

int8-quantization

Here are 18 public repositories matching this topic...

Language:All

Filter by language

All18 Python6 Jupyter Notebook3 C2 C#2 C++2 JavaScript1 Visual Basic .NET1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

willard-yuan /cvt

CVT, a Computer Vision Toolkit.

cbir sift fasttext opq image-matching vlfeat covdet hnsw int8-quantization

UpdatedAug 24, 2022
C

NJU-Jet /SR_Mobile_Quantization

Winner solution of mobile AI (CVPRW 2021).

super-resolution residual-learning network-quantization int8-quantization

UpdatedMay 14, 2022
Python

GiorgosXou /NeuralNetworks

A resource-conscious neural network library for microcontrollers

arduino avr attiny microcontrollers neural-network simple tensorflow lstm gru mnist neural-networks rnn mnist-dataset mlp maths quantization mnist-model mnist-handwriting-recognition int8-quantization quantization-efficient-network

UpdatedDec 17, 2025
C++

clovaai /frostnet

FrostNet: Towards Quantization-Aware Network Architecture Search

computer-vision deep-learning pytorch style-transfer classification object-detection quantization network-architecture semantic-segmentation optimizers quantization-aware-training int8-quantization post-quantization quantization-efficient-network

UpdatedMay 3, 2024
Python

jahongir7174 /YOLOv8-qat

Quantization Aware Training

python pytorch object-detection int8-inference quantization-aware-training int8-quantization yolov8

UpdatedJan 13, 2024
Python

Howell-Yang /onnx2trt

将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。

python tensorrt calibrator int8-inference int8-quantization

UpdatedAug 17, 2022
Python

ENOT-AutoDL /ENOT-transformers

transformers inference quantization tensorrt int8-inference gpt2 int8-quantization gptj enot-autodl

UpdatedJun 8, 2023

yester31 /TensorRT_ONNX

Generating tensorrt model using onnx

pytorch quantization tensorrt onnx int8-inference onnxruntime post-training-quantization int8-quantization tensorrt-inference ptq

UpdatedJun 22, 2023
C++

JohnClaw /chatllm.vb

VB.NET api wrapper for llm-inference chatllm.cpp

bindings api-wrapper llama vb-net vbnet gemma mistral int8 int8-inference int8-quantization cpu-inference chatllm ggml llm-inference qwen

UpdatedNov 26, 2024
Visual Basic .NET

JohnClaw /chatllm.cs

C# api wrapper for llm-inference chatllm.cpp

csharp inference bindings api-wrapper llama gemma mistral int8 int8-inference int8-quantization cpu-inference llm llms chatllm ggml llm-inference qwen

UpdatedNov 20, 2024
C#

dreuxx /Grammar-Checker-v2-BY-ML

Corrects your grammar in 5 languages directly in your browser. Powered by an open-source AI model.

javascript chrome-extension nlp machine-learning browser-extension collaborate student-project grammar-checker onnx int8-quantization t5-model github-copilot

UpdatedJul 12, 2025
JavaScript

Thehunk1206 /Arduino-Surrounding-Sound-Classifier

TinyML project. This system monitors your room or surrounding with an onboard microphone of Arduino nano BLE sense. Still Under Developement

arduino machine-learning deep-learning quantization tf-data audio-processing spectrograms tflite-conversion tflite-models arduino-nano-33-ble-sense int8-quantization tflite-micro

UpdatedOct 18, 2021
Jupyter Notebook

JohnClaw /gemma-2-2b-it.cs

gemma-2-2b-it int8 cpu inference in one file of pure C#

csharp inference quantization gemma int8 inference-engine model-serving int8-inference int8-quantization cpu-inference llm llms llm-serving llm-inference gemma2 gemma2-2b-it

UpdatedJun 14, 2025
C#

zoneburst

ghostproxies /zoneburst

ZoneBurst is an efficient PRNG algorithm for 8-bit output.

c fast alternative counter generator csharp x64 x86-64 prng rgb-colors deterministic int8 pseudorandom pixel-noise gaussian-noise practrand int8-quantization image-noise weyl

UpdatedDec 7, 2025
C

JayDS22 /Production-LLM-Serving-Optimization-Framework

High-performance LLM inference platform with vLLM continuous batching achieving 12.3K+ req/sec, 42ms P50/178ms P99 latency, INT8/INT4 quantization (70% memory savings), tensor parallelism across 4 GPUs, and comprehensive monitoring serving 1500+ concurrent users.

multimodal int8-quantization llm-serving inference-embedded-engine

UpdatedOct 3, 2025
Python

raj2022 /quantization_prunings

Post-Training quantization perfomed on the model trained with CLIC dataset.

post-training-quantization int8-quantization

UpdatedSep 1, 2025
Jupyter Notebook

Mohammed2372 /Translation-API

Translation API using Meta's NLLB-200 model with 200+ languages

docker django docker-compose django-rest-framework celery redis-cache int8-quantization translationapi ctranslate2 nllb200

UpdatedDec 5, 2025
Python

osa-bot /yndx-llm-scaling-week-2025

Yandex LLM Scaling Week 2025

gpu-optimization mixed-precision int8-quantization large-language-models triton-kernels

UpdatedDec 8, 2025
Jupyter Notebook

Improve this page

Add a description, image, and links to theint8-quantization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with theint8-quantization topic, visit your repo's landing page and select "manage topics."

[8]ページ先頭

©2009-2025 Movatter.jp