NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
-
Updated
Dec 13, 2024 - C++
#
tensorrt
Here are 240 public repositories matching this topic...
Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.
machine-learning embedded caffe computer-vision deep-learning robotics inference nvidia digits image-recognition segmentation object-detection jetson-tx1 jetson tensorrt jetson-tx2 video-analytics jetson-xavier jetson-nano jetson-xavier-nx
-
Updated
Oct 16, 2024 - C++
Implementation of popular deep learning networks with TensorRT network definition API
resnet squeezenet tensorrt crnn arcface mobilenetv2 yolov3 mnasnet retinaface mobilenetv3 yolov3-spp yolov4 yolov5 detr swin-transformer yolov7 yolov8 yolov9 yolo11
-
Updated
Dec 6, 2024 - C++
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …
ocr deep-learning tensorflow inference pytorch tengine face-detection tensorrt mnn coreml ncnn openvino hairsegmentaion
-
Updated
Dec 19, 2024 - C++
Tengine is a lite, high performance, modular inference engine for embedded device
machine-learning arm mips tensorflow x86-64 container cuda acl cnn pytorch artificial-intelligence riscv tensorrt onnx nvdla npu supperedge
-
Updated
Sep 15, 2024 - C++
🛠 A lite C++ toolkit of 100+ Awesome AI models, support ORT, MNN, NCNN, TNN and TensorRT. 🎉🎉
tensorrt mnn ncnn onnx ncnn-model onnxruntime yolov5 tnn tensorrt-inference mnn-model yolox robustvideomatting onnxruntime-gpu yolov6 yolov8
-
Updated
Dec 26, 2024 - C++
⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.
android intel rockchip object-detection jetson tensorrt serving onnx openvino onnxruntime graphcore yolov5 kunlun uie picodet stable-diffusion yolov8
-
Updated
Jan 16, 2025 - C++
C++ library based on tensorrt integration
-
Updated
May 24, 2023 - C++
Deep Learning API and Server in C++14 support for PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE
machine-learning caffe deep-learning time-series gpu rest-api pytorch xgboost image-classification image-search object-detection image-segmentation tsne neural-nets tensorrt ncnn tensorrt-conversion tensorrt-inference
-
Updated
Jan 21, 2025 - C++
🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~
pytorch transformer android-app tensorrt mnn mobilenet ncnn tflite shufflenetv2 onnxruntime yolov5 repvgg pplcnet openvivo picodet
-
Updated
Jun 22, 2024 - C++
NVIDIA DeepStream SDK 7.1 / 7.0 / 6.4 / 6.3 / 6.2 / 6.1.1 / 6.1 / 6.0.1 / 6.0 / 5.1 implementation for YOLO models
cuda pytorch nvidia yolo object-detection deepstream darknet paddle tensorrt ultralytics nvidia-deepstream-sdk ppyoloe mmyolo rtmdet rtdetr
-
Updated
Dec 6, 2024 - C++
🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎
cuda tensorrt yolov3 libfacedetection efficientdet yolov4 u2net yolov5 yolor yolox yolov6 yolov7 yolov8 rt-detr yolonas yolov8-seg yolov8-pose
-
Updated
Jul 19, 2024 - C++
TensorRT-YOLO: A high-performance, easy-to-use YOLO deployment toolkit for NVIDIA, powered by TensorRT plugins and CUDA Graph, supporting C++ and Python.
yolo classification segmentation object-detection pose-estimation jetson tensorrt model-deployment yolov3 yolov5 pp-yolo ultralytics yolov6 yolov7 yolov8 tensorrt-plugins yolov9 yolov10 tensorrt10 yolo11
-
Updated
Jan 21, 2025 - C++
Cross-platform, customizable multimedia/video processing framework. With strong GPU acceleration, heterogeneous design, multi-language support, easy to use, multi-framework compatible and high performance, the framework is ideal for transcoding, AI inference, algorithm integration, live video streaming, and more.
python opencv arm ai ffmpeg cross-platform cpp multimedia gpu numpy x86-64 cuda nvidia bmf heterogeneous transcode mediacodec tensorrt live-video bytedance
-
Updated
Jan 9, 2025 - C++
Adlik: Toolkit for Accelerating Deep Learning Inference
deep-learning compiler inference docker-images tensorflow-serving tensorrt inference-engine openvino model-optimizer
-
Updated
Dec 27, 2023 - C++
nndeploy is an end-to-end model deployment framework. Based on multi-terminal inference and directed acyclic graph model deployment, it is committed to providing users with a cross-platform, easy-to-use, and high-performance model deployment experience.
hpc parallel yolo easy-to-use tensorrt mnn model-deployment openvino ascend rknn multi-inference out-of-box-model
-
Updated
Jan 19, 2025 - C++
TensorRT C++ API Tutorial
-
Updated
Nov 15, 2024 - C++
Improve this page
Add a description, image, and links to the tensorrt topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the tensorrt topic, visit your repo's landing page and select "manage topics."