Alternatives and similar repositories for ONNX-TensorRT-LibTorch

Users that are interested in ONNX-TensorRT-LibTorch are comparing it to the libraries listed below

• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated 2 years ago
• hpc203 / picodet-onnxruntime
  使用ONNXRuntime部署PicoDet目标检测，包含C++和Python两个版本的程序
  ☆30Updated 3 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆50Updated 2 years ago
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆19Updated last year
• DataXujing / YOLOv6
  手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程
  ☆33Updated 3 years ago
• hpc203 / face-gaze-estimation-opencv-dnn
  使用OpenCV部署L2CS-Net人脸朝向估计，包含C++和Python两个版本的程序，只依赖opencv库就可以运行
  ☆20Updated 2 years ago
• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆10Updated 3 years ago
• hpc203 / Detic-onnxrun-cpp-py
  使用ONNXRuntime部署Detic检测2万1千种类别的物体，包含C++和Python两个版本的程序
  ☆17Updated 2 years ago
• MaybeShewill-CV / mortred_model_server
  High Performan Ai Model Web Server. Mainly support computer vision model. Quickly establish your own ai-model server. https://github.com/…
  ☆43Updated 4 months ago
• lin-honghui / data-competition-calendar
  国内外数据竞赛资讯整理
  ☆18Updated 3 years ago
• eshoyuan / PaddleOCR_TensorRT_cpp
  This project provides simple code and demonstrates how to use the TensorRT C++ API and ONNX to deploy PaddleOCR text recognition model.
  ☆48Updated 3 years ago
• leoluopy / autotvm_tutorial
  autoTVM神经网络推理代码优化搜索演示，基于tvm编译开源模型centerface，并使用autoTVM搜索最优推理代码，　最终部署编译为c++代码，演示平台是cuda，可以是其他平台，例如树莓派，安卓手机，苹果手机．Thi is a demonstration of …
  ☆28Updated 4 years ago
• xiaqing10 / RKNN_YOLOV5S_CPP
  基于rknn的yolov5的cpp实现，包含各种依赖库，是一个完整工程，可直接编译运行
  ☆21Updated 3 years ago
• cvdong / YOLO_TRT_SIM
  高效部署：YOLO X, V3, V4, V5, V6, V7, V8, EdgeYOLO TRT推理 ™️ ,前后处理均由CUDA核函数实现 CPP/CUDA🚀
  ☆50Updated 2 years ago
• ZHEQIUSHUI / CLIP-ONNX-AX650-CPP
  c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP
  ☆30Updated 3 months ago
• Tramac / tensorrt-tutorial
  TensorRT简明教程
  ☆26Updated 4 years ago
• hpc203 / yolor-onnxruntime
  使用ONNXRuntime部署anchor-free系列的YOLOR，包含C++和Python两种版本的程序
  ☆41Updated 4 years ago
• FeiGeChuanShu / yolov7-mask-ncnn
  c++ version of yolov7-mask with ncnn
  ☆59Updated 3 years ago
• shouxieai / bp-cpp
  彻底弄懂BP反向传播，15行代码，C++实现也简单，MNIST分类98.29%精度
  ☆37Updated 3 years ago
• lucasjinreal / yolov7-face
  Next Gen Face detection based on YOLOv7
  ☆62Updated 2 years ago
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆47Updated last year
• watersink / enet-as-linux
  基于ncnn的android端的enet分割
  ☆17Updated 5 years ago
• thomaszheng / OcrLiteMnn
  ChineseOcr Lite Mnn，超轻量级中文OCR PC Demo，使用MNN推理
  ☆27Updated 4 years ago
• xiaochus / DeepModelDeploy
  Deploy deep learning model on difference hardware and framework. (TensorRT/ONNX/MNN/RKNN)
  ☆13Updated 3 years ago
• careful1128 / learning-cuda-trt
  ☆12Updated 2 years ago
• hpc203 / pp-yoloe-onnxrun-cpp-py
  使用ONNXRuntime部署PP-YOLOE目标检测，支持PP-YOLOE-s、PP-YOLOE-m、PP-YOLOE-l、PP-YOLOE-x四种结构，包含C++和Python两个版本的程序
  ☆21Updated 3 years ago
• sherlockchou86 / PyLangPipe
  a simple lightweight large language model pipeline framework.
  ☆26Updated 5 months ago
• Zhengtq / ncnn_breakdown
  A breakdown of NCNN
  ☆46Updated 4 years ago
• elevator-214 / elevator-monitor
  Intelligent monitoring of escalator.Function including traffic statistics,passenger retention detection and large object retention detect…
  ☆26Updated last year