tensorrt

Star

Here are 764 public repositories matching this topic...

Language:All

Filter by language

All764 Python364 C++251 Jupyter Notebook65 Dockerfile12 Cuda10 C7 Shell7 Rust4 Makefile3 Go2

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

NVIDIA /TensorRT

Star11.9k

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

deep-learning inference nvidia gpu-acceleration tensorrt

UpdatedJul 9, 2025
C++

Megvii-BaseDetection /YOLOX

Star9.9k

YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation:https://yolox.readthedocs.io/

deep-learning pytorch yolo object-detection tensorrt ncnn onnx yolov3 openvino megengine yolox

UpdatedJun 8, 2025
Python

dusty-nv /jetson-inference

Star8.4k

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

machine-learning embedded caffe computer-vision deep-learning robotics inference nvidia digits image-recognition segmentation object-detection jetson-tx1 jetson tensorrt jetson-tx2 video-analytics jetson-xavier jetson-nano jetson-xavier-nx

UpdatedOct 16, 2024
C++

mikel-brostrom /boxmot

Sponsor

Star7.5k

BoxMOT: Pluggable SOTA multi-object tracking modules modules for segmentation, object detection and pose estimation models

machine-learning deep-learning yolo segmentation clip multi-object-tracking mot tensorrt tracking-by-detection mots osnet multi-object-tracking-segmentation bytetrack strongsort ocsort botsort deepocsort improvedassociation boosttrack oriented-bounding-box-tracking

UpdatedJul 14, 2025
Python

wang-xinyu /tensorrtx

Star7.4k

Implementation of popular deep learning networks with TensorRT network definition API

resnet squeezenet tensorrt crnn arcface mobilenetv2 yolov3 mnasnet retinaface mobilenetv3 yolov3-spp yolov4 yolov5 detr swin-transformer yolov7 yolov8 yolov9 yolo11

UpdatedMay 10, 2025
C++

NVIDIA-AI-IOT /torch2trt

Star4.8k

An easy to use PyTorch to TensorRT converter

inference pytorch classification tensorrt jetson-tx2 jetson-xavier jetson-nano

UpdatedAug 17, 2024
Python

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

ocr deep-learning tensorflow inference pytorch tengine face-detection tensorrt mnn coreml ncnn openvino hairsegmentaion

UpdatedMay 9, 2025
C++

Tianxiaomo /pytorch-YOLOv4

Star4.5k

PyTorch ,ONNX and TensorRT implementation of YOLOv4

pytorch tensorrt onnx yolov3 yolov4 pytorch-yolov4 darknet2pytorch yolov4-tiny darknet2onnx

UpdatedJun 19, 2024
Python

OAID /Tengine

Star4.5k

Tengine is a lite, high performance, modular inference engine for embedded device

machine-learning arm mips tensorflow x86-64 container cuda acl cnn pytorch artificial-intelligence riscv tensorrt onnx nvdla npu supperedge

UpdatedMar 6, 2025
C++

xlite-dev /lite.ai.toolkit

Star4.2k

🛠 A lite C++ AI toolkit: 100+ models with MNN, ORT and TRT, including Det, Seg, Stable-Diffusion, Face-Fusion, etc.🎉

tensorrt mnn ncnn onnx onnxruntime yolov5 tnn mnn-model yolox robustvideomatting yolov6 stable-diffusion yolov8 facefusion

UpdatedJul 14, 2025
C++

TingsongYu /PyTorch-Tutorial-2nd

Star3.8k

《Pytorch实用教程》（第二版）无论是零基础入门，还是CV、NLP、LLM项目应用，或是进阶工程化部署落地，在这里都有。相信在本书的帮助下，读者将能够轻松掌握 PyTorch 的使用，成为一名优秀的深度学习工程师。

computer-vision pytorch tensorrt pytorch-tutorial onnx deepsort diffusion-models yolov5 llm qwen

UpdatedJan 27, 2025
Jupyter Notebook

NVIDIA /GenerativeAIExamples

Star3.3k

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

microservice gpu-acceleration nemo tensorrt rag triton-inference-server large-language-models llm llm-inference retrieval-augmented-generation

UpdatedJul 16, 2025
Jupyter Notebook

lucasjinreal /yolov7_d2

Star3.1k

🔥🔥🔥🔥 (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! 🔥🔥🔥

detection transformers face yolo object-detection tensorrt instance-segmentation onnx detr yolox yolov6 detextron2 yolov7

UpdatedNov 18, 2023
Python

collabora /WhisperLive

Star3.1k

A nearly-live implementation of OpenAI's Whisper.

text-to-speech translation voice-recognition openai obs dictation whisper tensorrt openvino openvino-intel tensorrt-llm whisper-tensorrt

UpdatedJul 16, 2025
Python

tinyvision /DAMO-YOLO

Star3.1k

DAMO-YOLO: a fast and accurate object detection method with some new techs, including NAS backbones, efficient RepGFPN, ZeroHead, AlignedOTA, and distillation enhancement.

deep-learning pytorch yolo imagenet object-detection nas tensorrt onnx yolov5 damo-yolo