Alternatives and similar repositories for ONNX-Runtime-Inference:

Users that are interested in ONNX-Runtime-Inference are comparing it to the libraries listed below

• xmba15 / onnx_runtime_cpp
  small c++ library to quickly deploy models using onnxruntime
  ☆343Updated 8 months ago
• iwatake2222 / InferenceHelper
  C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ON…
  ☆285Updated 2 years ago
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆287Updated 10 months ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆258Updated last year
• cassiebreviu / cpp-onnxruntime-resnet-console-app
  Simple console app that implements ONNX Runtime and ResNet in C++
  ☆47Updated last year
• ttanzhiqiang / onnx_tensorrt_project
  Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxn…
  ☆214Updated 3 years ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆89Updated 4 months ago
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆281Updated 2 years ago
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆193Updated 3 years ago
• cyrusbehr / tensorrt-cpp-api
  TensorRT C++ API Tutorial
  ☆675Updated 3 months ago
• aadhithya / onnx-typecast
  Script to typecast ONNX model parameters from INT64 to INT32.
  ☆103Updated 10 months ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆121Updated 2 weeks ago
• yasenh / libtorch-yolov5
  A LibTorch inference implementation of the yolov5
  ☆377Updated 4 years ago
• PINTO0309 / openvino2tensorflow
  This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and…
  ☆340Updated 2 years ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆418Updated 2 months ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆153Updated 9 months ago
• iwatake2222 / play_with_tflite
  Sample projects for TensorFlow Lite in C++ with delegates such as GPU, EdgeTPU, XNNPACK, NNAPI
  ☆368Updated 2 years ago
• linghu8812 / tensorrt_inference
  ☆707Updated last year
• agrechnev / trt-cpp-min
  TensorRT 7 C++ (almost) minimal examples
  ☆79Updated last year
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆556Updated last week
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆763Updated last year
• AllentDan / LibtorchDetection
  C++ trainable detection library based on libtorch (or pytorch c++). Yolov4 tiny provided now.
  ☆108Updated 2 years ago
• ValYouW / tflite-win-c
  Visual Studio C++ demo app for running ssd object detection and deeplab image segmentation on windows using TensorFlow Lite C api
  ☆39Updated 3 years ago
• RizhaoCai / PyTorch_ONNX_TensorRT
  A tutorial about how to build a TensorRT Engine from a PyTorch Model with the help of ONNX
  ☆243Updated 4 years ago
• BIGBALLON / PyTorch-CPP
  PyTorch C++ inference with LibTorch
  ☆329Updated 4 years ago
• NobuoTsukamoto / tensorrt-examples
  TensorRT Examples (TensorRT, Jetson Nano, Python, C++)
  ☆94Updated last year
• NVIDIA-AI-IOT / tensorrt_plugin_generator
  A simple tool that can generate TensorRT plugin code quickly.
  ☆228Updated last year
• iwatake2222 / play_with_tensorrt
  Sample projects for TensorRT in C++
  ☆194Updated 2 years ago
• sithu31296 / PyTorch-ONNX-TFLite
  Conversion of PyTorch Models into TFLite
  ☆370Updated last year
• NVIDIA-AI-IOT / cuDLA-samples
  YOLOv5 on Orin DLA
  ☆191Updated last year