Alternatives and similar repositories for ONNX-Runtime-Inference

Users that are interested in ONNX-Runtime-Inference are comparing it to the libraries listed below

• xmba15 / onnx_runtime_cpp
  small c++ library to quickly deploy models using onnxruntime
  ☆355Updated 11 months ago
• aadhithya / onnx-typecast
  Script to typecast ONNX model parameters from INT64 to INT32.
  ☆107Updated last year
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆261Updated last year
• ttanzhiqiang / onnx_tensorrt_project
  Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxn…
  ☆212Updated 3 years ago
• iwatake2222 / InferenceHelper
  C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ON…
  ☆287Updated 3 years ago
• AllentDan / LibtorchDetection
  C++ trainable detection library based on libtorch (or pytorch c++). Yolov4 tiny provided now.
  ☆108Updated 2 years ago
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆285Updated 2 years ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆92Updated 7 months ago
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆293Updated last year
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆196Updated 3 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆768Updated last year
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆270Updated 5 months ago
• BIGBALLON / PyTorch-CPP
  PyTorch C++ inference with LibTorch
  ☆329Updated 4 years ago
• onnx / optimizer
  ONNX Optimizer
  ☆715Updated this week
• yasenh / libtorch-yolov5
  A LibTorch inference implementation of the yolov5
  ☆377Updated 4 years ago
• cassiebreviu / cpp-onnxruntime-resnet-console-app
  Simple console app that implements ONNX Runtime and ResNet in C++
  ☆49Updated 2 years ago
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆108Updated last month
• cyrusbehr / tensorrt-cpp-api
  TensorRT C++ API Tutorial
  ☆715Updated 6 months ago
• linghu8812 / tensorrt_inference
  ☆711Updated last year
• Hexmagic / ONNX-yolov5
  deploy yolov5 in c++
  ☆107Updated 2 years ago
• saurabh-shandilya / onnx-utils
  Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…
  ☆79Updated 3 years ago
• itsnine / yolov5-onnxruntime
  YOLOv5 ONNX Runtime C++ inference code.
  ☆264Updated last year
• agrechnev / trt-cpp-min
  TensorRT 7 C++ (almost) minimal examples
  ☆80Updated last year
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆231Updated last year
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆139Updated 3 years ago
• Vertical-Beach / ByteTrack-cpp
  C++ implementation of ByteTrack that does not include an object detection algorithm.
  ☆181Updated last year
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆587Updated 2 weeks ago
• royinx / CUDA_Resize
  resize image in (CUDA, python, cupy)
  ☆41Updated last year
• zhiqwang / yolort
  yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.
  ☆729Updated 2 months ago
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆388Updated last week