基于TensorRT的C++高性能推理库，Yolov10, YoloPv2，Yolov5/7/X/8，RT-DETR，单目标跟踪OSTrack、LightTrack。
☆224Jun 12, 2024Updated last year
Alternatives and similar repositories for Linfer
Users that are interested in Linfer are comparing it to the libraries listed below
Sorting:
- 基于 TensorRT 的 C++ 高性能单目标跟踪推理，支持算法OSTrack、LightTrack。☆62Nov 2, 2023Updated 2 years ago
- 本仓库基于 Intel OpenVINO Toolkit 部署 LightTrack 跟踪算法，包含 Python、C++ 两种语言的推理代码.☆21Nov 2, 2023Updated 2 years ago
- 🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yol…☆136May 4, 2024Updated last year
- ☆113Mar 11, 2024Updated last year
- yolov5 tensorrt int8量化方法汇总☆86Dec 12, 2023Updated 2 years ago
- This repository is based on shouxieai/tensorRT_Pro, with adjustments to support YOLOv8.☆405Jan 15, 2026Updated last month
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆13Mar 5, 2025Updated 11 months ago
- TensorRT for YOLOv10 with CUDA☆13Jan 24, 2025Updated last year
- An object tracking project with YOLOv8 and ByteTrack, speed up by C++ and TensorRT.☆231Nov 1, 2025Updated 4 months ago
- 本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！☆16Jun 14, 2023Updated 2 years ago
- TensorRT+YOLO系列的 多路 多卡 多实例 并行视频分析处理案例☆323Feb 10, 2025Updated last year
- 使用TensorRT加速YOLOv8-Seg，完整的后端框架，包括Http服务器，Mysql数据库，ffmpeg视频推流等。☆88Oct 9, 2023Updated 2 years ago
- 对 tensorRT_Pro 开源项目理解☆22Feb 23, 2023Updated 3 years ago
- This repository give a guidline to learn CUDA and TensorRT from the beginning.☆322Feb 17, 2025Updated last year
- ☆17Nov 14, 2023Updated 2 years ago
- learn TensorRT from scratch🥰☆18Sep 29, 2024Updated last year
- opencv调用jetson/rk3588 mpp硬解码，重写了open与read函数，支持h264/h265☆14Nov 27, 2025Updated 3 months ago
- Speed up image preprocess with cuda when handle image or tensorrt inference☆85Nov 5, 2025Updated 3 months ago
- 高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀☆53Feb 23, 2023Updated 3 years ago
- Mnn version demo of [ECCV2022] Joint Feature Learning and Relation Modeling for Tracking: A One-Stream Framework.☆20Aug 30, 2023Updated 2 years ago
- A new tensorrt integrate. Easy to integrate many tasks☆451Apr 2, 2023Updated 2 years ago
- YOLOv5 on Orin DLA☆221Feb 18, 2024Updated 2 years ago
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 2 years ago
- Merge superpoint、lightglue、MixVPR into VINS-FUSION for loop closure with TensorRT☆149Nov 12, 2024Updated last year
- C++ app for computer vision inference, supporting multiple tasks and backends.☆93Updated this week
- a simple lightweight large language model pipeline framework.☆28Apr 25, 2025Updated 10 months ago
- 一款简单易用和高性能的AI部署框架 | An Easy-to-Use and High-Performance AI Deployment Framework☆1,743Feb 23, 2026Updated last week
- 🚀 Easier & Faster YOLO Deployment Toolkit for NVIDIA 🛠️☆1,705Jan 7, 2026Updated last month
- 10000 fps 🚀 for 360 Surround-View CUDA Solution☆145Dec 23, 2023Updated 2 years ago
- [CVPR 2023] OC-SORT implemented in C++ with Eigen Library, Plus a Android Demo Apk☆68Dec 24, 2025Updated 2 months ago
- c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP☆31Jun 19, 2025Updated 8 months ago
- DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。☆12Jan 9, 2024Updated 2 years ago
- ☆10Jul 18, 2024Updated last year
- 🔥🔥🔥TensorRT for YOLOv8、YOLOv8-Pose、YOLOv8-Seg、YOLOv8-Cls、YOLOv7、YOLOv6、YOLOv5、YOLONAS......🚀🚀🚀CUDA IS ALL YOU NEED.🍎🍎🍎☆1,419Jul 19, 2024Updated last year
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆70Oct 7, 2023Updated 2 years ago
- Serving Inside Pytorch☆170Feb 3, 2026Updated 3 weeks ago
- RKNN version demo of [CVPR21] LightTrack: Finding Lightweight Neural Network for Object Tracking via One-Shot Architecture Search☆24Dec 24, 2021Updated 4 years ago
- TensorRT-FastSAM(https://github.com/CASIA-IVA-Lab/FastSAM)☆23Feb 29, 2024Updated 2 years ago
- An onnx-based quantitation tool.☆71Jan 8, 2024Updated 2 years ago