microsoft / onnxruntime-inference-examples

Related projects ⓘ

Alternatives and complementary repositories for onnxruntime-inference-examples

• ZhangGe6 / onnx-modifier
  A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.
  ☆1,346Updated 2 weeks ago
• onnx / optimizer
  Actively maintained ONNX Optimizer
  ☆647Updated 8 months ago
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆338Updated this week
• onnx / tensorflow-onnx
  Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX
  ☆2,327Updated 2 months ago
• daquexian / onnx-simplifier
  Simplify your onnx model
  ☆3,865Updated 2 months ago
• microsoft / Olive
  Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
  ☆1,594Updated this week
• microsoft / onnxruntime-training-examples
  Examples for using ONNX Runtime for model training.
  ☆312Updated 3 weeks ago
• onnx / onnx-tensorrt
  ONNX-TensorRT: TensorRT backend for ONNX
  ☆2,953Updated 2 weeks ago
• PINTO0309 / onnx2tf
  Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…
  ☆705Updated 3 weeks ago
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,024Updated 5 months ago
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆400Updated this week
• microsoft / onnxruntime-genai
  Generative AI extensions for onnxruntime
  ☆514Updated this week
• CVCUDA / CV-CUDA
  CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.
  ☆2,381Updated last month
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆251Updated 5 months ago
• intel / neural-compressor
  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…
  ☆2,227Updated this week
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,597Updated this week
• NVIDIA / trt-samples-for-hackathon-cn
  Simple samples for TensorRT programming
  ☆1,519Updated 2 weeks ago
• cyrusbehr / tensorrt-cpp-api
  TensorRT C++ API Tutorial
  ☆626Updated this week
• pnnx / pnnx
  PyTorch Neural Network eXchange
  ☆526Updated this week
• ENOT-AutoDL / onnx2torch
  Convert ONNX models to PyTorch.
  ☆620Updated 3 months ago
• onnx / onnx-tensorflow
  Tensorflow Backend for ONNX
  ☆1,284Updated 7 months ago
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆286Updated this week
• openvinotoolkit / nncf
  Neural Network Compression Framework for enhanced OpenVINO™ inference
  ☆943Updated this week
• google-ai-edge / ai-edge-torch
  Supporting PyTorch models with the Google AI Edge TFLite runtime.
  ☆371Updated this week
• open-mmlab / mmdeploy
  OpenMMLab Model Deployment Framework
  ☆2,777Updated last month
• xmba15 / onnx_runtime_cpp
  small c++ library to quickly deploy models using onnxruntime
  ☆328Updated 4 months ago
• DefTruth / lite.ai.toolkit
  🛠 A lite C++ toolkit of 100+ awesome AI models, support ONNXRuntime, MNN, TNN, NCNN and TensorRT.
  ☆3,661Updated 3 weeks ago
• OpenPPL / ppq
  PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.
  ☆1,558Updated 7 months ago
• Talmaj / onnx2pytorch
  Transform ONNX model to PyTorch representation
  ☆318Updated last week
• leimao / ONNX-Runtime-Inference
  ONNX Runtime Inference C++ Example
  ☆222Updated last year