Alternatives and similar repositories for inference-server:

Users that are interested in inference-server are comparing it to the libraries listed below

• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆138Updated 2 weeks ago
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆74Updated 4 months ago
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆87Updated 4 months ago
• Xilinx / pyxir
  ☆37Updated 2 years ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆83Updated last year
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆31Updated 2 weeks ago
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆83Updated this week
• ROCm / MISA
  Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)
  ☆34Updated 5 months ago
• ROCm / rocMLIR
  ☆137Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆168Updated this week
• cornell-zhang / hcl-dialect
  HeteroCL-MLIR dialect for accelerator design
  ☆41Updated 5 months ago
• amd / UIF
  ☆59Updated last year
• ROCm / rocWMMA
  rocWMMA
  ☆102Updated this week
• google / mlir-npcomp
  npcomp - An aspirational MLIR based numpy compiler
  ☆51Updated 4 years ago
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆115Updated 2 months ago
• spcl / mlir-dace
  Data-Centric MLIR dialect
  ☆40Updated last year
• Xilinx / mlir-air
  ☆90Updated this week
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆54Updated this week
• vortexgpgpu / pocl
  a clone of POCL that includes RISC-V newlib devices support and Vortex
  ☆40Updated last month
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆115Updated 4 months ago
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆50Updated 7 months ago
• ROCm / roctracer
  ROCm Tracer Callback/Activity Library for Performance tracing AMD GPUs
  ☆79Updated this week
• openxla / shardy
  MLIR-based partitioning system
  ☆71Updated this week
• Zhao-Dongyu / sgemm_riscv
  This project records the process of optimizing SGEMM (single-precision floating point General Matrix Multiplication) on the riscv platfor…
  ☆19Updated 3 months ago
• stanford-ppl / spatial-multiverse
  Provides Spatial with front-end support from popular machine learning frameworks
  ☆33Updated 5 years ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆39Updated 10 months ago
• Xilinx / mlir-xten
  ☆13Updated this week
• iml130 / mlir-emitc
  Conversions to MLIR EmitC
  ☆127Updated 3 months ago
• uiuc-arc / felix
  Optimize tensor program fast with Felix, a gradient descent autotuner.
  ☆24Updated 10 months ago
• NodLabs / mlir-examples
  a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]
  ☆33Updated 4 years ago