Alternatives and similar repositories for onnxruntime-tvm:

Users that are interested in onnxruntime-tvm are comparing it to the libraries listed below

• IBM / onnx-mlir-serving
  ONNX Serving is a project written with C++ to serve onnx-mlir compiled models with GRPC and other protocols.Benefiting from C++ implement…
  ☆22Updated last year
• masahi / torchscript-to-tvm
  ☆69Updated last year
• MingliSun / MLIR-TVM
  ☆12Updated 5 years ago
• tobegit3hub / tftvm
  TensorFlow and TVM integration
  ☆37Updated 4 years ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆207Updated this week
• kendryte / Toucan-LLM
  Self-trained Large Language Models based on Meta LLaMa
  ☆30Updated last year
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆68Updated this week
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆52Updated 3 years ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• carlushuang / cpu_gemm_opt
  how to design cpu gemm on x86 with avx256, that can beat openblas.
  ☆67Updated 5 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆52Updated 2 years ago
• mlc-ai / relax
  ☆157Updated this week
• mlcommons / inference_policies
  Issues related to MLPerf™ Inference policies, including rules and suggested changes
  ☆59Updated last week
• zhenhuaw-me / tflite
  Parse TFLite models (*.tflite) EASILY with Python. Check the API at https://zhenhuaw.me/tflite/docs/
  ☆98Updated 2 weeks ago
• jiazhihao / sosp19ae
  Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions
  ☆21Updated 2 years ago
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆127Updated last year
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆23Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆257Updated 2 months ago
• microsoft / torchy
  A tracing JIT for PyTorch
  ☆17Updated 2 years ago
• microsoft / FractalTensor
  ☆23Updated last month
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆38Updated 9 months ago
• asprasad / treebeard
  An optimizing compiler for decision tree ensemble inference.
  ☆17Updated this week
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆33Updated 2 years ago
• NVIDIA / sampleQAT
  Inference of quantization aware trained networks using TensorRT
  ☆80Updated 2 years ago
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆26Updated 4 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year