Alternatives and similar repositories for inference-server

Users that are interested in inference-server are comparing it to the libraries listed below

• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆82Updated 4 months ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆155Updated last month
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆102Updated 2 weeks ago
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆97Updated 2 months ago
• xmos / ai_tools
  AI applications and tools
  ☆29Updated 3 weeks ago
• Xilinx / pyxir
  ☆37Updated 3 years ago
• graphcore / poplibs
  Poplar libraries
  ☆121Updated last year
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆132Updated 8 months ago
• google / mlir-npcomp
  npcomp - An aspirational MLIR based numpy compiler
  ☆51Updated 5 years ago
• Xilinx / llvm-aie
  Fork of LLVM to support AMD AIEngine processors
  ☆156Updated last week
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆77Updated 4 years ago
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆120Updated 10 months ago
• amd / UIF
  ☆60Updated last year
• polymage-labs / mlirx
  MLIRX is now defunct. Please see PolyBlocks - https://docs.polymagelabs.com
  ☆38Updated last year
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆84Updated last year
• NodLabs / mlir-examples
  a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]
  ☆35Updated 4 years ago
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆40Updated last month
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆87Updated 2 years ago
• escalab / GPTPU
  GPTPU for SC 2021
  ☆52Updated 2 years ago
• Xilinx / mlir-air
  ☆105Updated this week
• Xilinx / XRM
  XRM (Xilinx FPGA Resource Manager) Document:
  ☆25Updated last year
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆55Updated last year
• lightsighter / CudaDMA
  Emulating DMA Engines on GPUs for Performance and Portability
  ☆41Updated 10 years ago
• Xilinx / gemx
  Matrix Operation Library for FPGA https://xilinx.github.io/gemx/
  ☆63Updated 5 years ago
• tenstorrent / tt-umd
  User-Mode Driver for Tenstorrent hardware
  ☆31Updated this week
• tum-ei-eda / muriscv-nn
  muRISCV-NN is a collection of efficient deep learning kernels for embedded platforms and microcontrollers.
  ☆85Updated last week
• WuDan0399 / Integrate-NVDLA-and-TVM
  ☆32Updated 2 years ago
• NVIDIA / jetson-rdma-picoevb
  Minimal HW-based demo of GPUDirect RDMA on NVIDIA Jetson AGX Xavier running L4T
  ☆192Updated last year
• ROCm / rocMLIR
  ☆148Updated this week
• iml130 / mlir-emitc
  Conversions to MLIR EmitC
  ☆133Updated 8 months ago