Alternatives and similar repositories for onnx-mlir-serving

Users that are interested in onnx-mlir-serving are comparing it to the libraries listed below

• meta-pytorch / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆45Updated last month
• nod-ai / SHARK-ModelDev
  Unified compiler/runtime for interfacing with PyTorch Dynamo.
  ☆101Updated last month
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆26Updated last week
• makslevental / nelli
  A lightweight, Pythonic, frontend for MLIR
  ☆80Updated last year
• iree-org / iree-nvgpu
  ☆50Updated last year
• nunoplopes / torchy
  A tracing JIT compiler for PyTorch
  ☆13Updated 3 years ago
• MLIR-China / mlir-playground
  Play with MLIR right in your browser
  ☆136Updated 2 years ago
• microsoft / Accera
  Open source cross-platform compiler for compute-intensive loops used in AI algorithms, from Microsoft Research
  ☆109Updated 2 years ago
• meta-pytorch / tlparse
  TORCH_LOGS parser for PT2
  ☆61Updated 2 weeks ago
• google / ruy
  ☆315Updated 2 months ago
• masahi / torchscript-to-tvm
  ☆68Updated 2 years ago
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆282Updated last month
• mlc-ai / relax
  ☆165Updated last week
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆55Updated last year
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆33Updated 2 years ago
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆134Updated 2 years ago
• iml130 / mlir-emitc
  Conversions to MLIR EmitC
  ☆133Updated 9 months ago
• openxla / shardy
  MLIR-based partitioning system
  ☆136Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆111Updated last year
• tlc-pack / tlcpack
  ☆24Updated last year
• iree-org / iree-llvm-sandbox
  A sandbox for quick iteration and experimentation on projects related to IREE, MLIR, and LLVM
  ☆60Updated 6 months ago
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆181Updated last month
• spcl / pymlir
  Python interface for MLIR - the Multi-Level Intermediate Representation
  ☆267Updated 10 months ago
• polymage-labs / mlirx
  MLIRX is now defunct. Please see PolyBlocks - https://docs.polymagelabs.com
  ☆38Updated last year
• iree-org / iree-turbine
  IREE's PyTorch Frontend, based on Torch Dynamo.
  ☆98Updated this week
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆296Updated last year
• Xilinx / inference-server
  ☆47Updated last year
• onnx / neural-compressor
  Model compression for ONNX
  ☆97Updated 10 months ago
• syoyo / safetensors-cpp
  Header-only safetensors loader and saver in C++
  ☆67Updated 5 months ago
• meta-pytorch / tokenizers
  C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
  ☆36Updated this week