Alternatives and similar repositories for ONNX-Runtime-Inference

Users that are interested in ONNX-Runtime-Inference are comparing it to the libraries listed below

• iwatake2222 / InferenceHelper
  C++ Helper Class for Deep Learning Inference Frameworks: TensorFlow Lite, TensorRT, OpenCV, OpenVINO, ncnn, MNN, SNPE, Arm NN, NNabla, ON…
  ☆299Updated 3 years ago
• xmba15 / onnx_runtime_cpp
  small c++ library to quickly deploy models using onnxruntime
  ☆386Updated last year
• aadhithya / onnx-typecast
  Script to typecast ONNX model parameters from INT64 to INT32.
  ☆112Updated last year
• ilpropheta / onnxruntime-demo
  OnnxRuntime in C++ demo content of my talk
  ☆32Updated 4 years ago
• saurabh-shandilya / onnx-utils
  Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…
  ☆80Updated 4 years ago
• grimoire / torch2trt_dynamic
  A pytorch to tensorrt convert with dynamic shape support
  ☆267Updated last year
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆286Updated 3 years ago
• iwatake2222 / play_with_tflite
  Sample projects for TensorFlow Lite in C++ with delegates such as GPU, EdgeTPU, XNNPACK, NNAPI
  ☆381Updated 3 years ago
• wang-xinyu / pytorchx
  Implement popular deep learning networks in pytorch, used by tensorrtx.
  ☆197Updated 4 years ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆95Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆163Updated 2 months ago
• Vertical-Beach / ByteTrack-cpp
  C++ implementation of ByteTrack that does not include an object detection algorithm.
  ☆222Updated last year
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆303Updated last year
• ttanzhiqiang / onnx_tensorrt_project
  Support Yolov5(4.0)/Yolov5(5.0)/YoloR/YoloX/Yolov4/Yolov3/CenterNet/CenterFace/RetinaFace/Classify/Unet. use darknet/libtorch/pytorch/mxn…
  ☆210Updated 4 years ago
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆129Updated 8 months ago
• cassiebreviu / cpp-onnxruntime-resnet-console-app
  Simple console app that implements ONNX Runtime and ResNet in C++
  ☆48Updated 2 years ago
• ValYouW / tflite-win-c
  Visual Studio C++ demo app for running ssd object detection and deeplab image segmentation on windows using TensorFlow Lite C api
  ☆39Updated 3 years ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆300Updated last week
• yasenh / libtorch-yolov5
  A LibTorch inference implementation of the yolov5
  ☆378Updated 5 years ago
• BIGBALLON / PyTorch-CPP
  PyTorch C++ inference with LibTorch
  ☆334Updated 5 years ago
• karthickai / tflite
  TensorFlow Lite (tflite) C++ Series
  ☆68Updated 3 years ago
• koba-jon / pytorch_cpp
  Deep Learning sample programs using PyTorch in C++
  ☆306Updated 3 weeks ago
• NobuoTsukamoto / tensorrt-examples
  TensorRT Examples (TensorRT, Jetson Nano, Python, C++)
  ☆101Updated 2 years ago
• NVIDIA-AI-IOT / yolov5_gpu_optimization
  This repository provides YOLOV5 GPU optimization sample
  ☆106Updated 3 years ago
• iwatake2222 / play_with_tensorrt
  Sample projects for TensorRT in C++
  ☆198Updated 2 years ago
• tienluongngoc / yolov5_triton_inference_server
  ☆53Updated 3 years ago
• NVIDIA-AI-IOT / deepstream_triton_model_deploy
  How to deploy open source models using DeepStream and Triton Inference Server
  ☆86Updated last year
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆665Updated this week
• DeepVAC / libdeepvac
  Use PyTorch model in C++ project
  ☆139Updated 4 years ago
• bobbych94 / YOLOX-deepstream
  deploy yolox algorithm use deepstream
  ☆91Updated 4 years ago