Alternatives and similar repositories for inference-server

Users that are interested in inference-server are comparing it to the libraries listed below

• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆83Updated 8 months ago
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆115Updated last week
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆168Updated 2 weeks ago
• Xilinx / pyxir
  ☆37Updated 3 years ago
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆40Updated 4 months ago
• amd / UIF
  ☆60Updated 2 years ago
• Xilinx / llvm-aie
  Fork of LLVM to support AMD AIEngine processors
  ☆178Updated this week
• xmos / ai_tools
  AI applications and tools
  ☆30Updated last month
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆42Updated 10 months ago
• ROCm / roctracer
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆84Updated 2 weeks ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆88Updated 2 years ago
• iml130 / mlir-emitc
  Conversions to MLIR EmitC
  ☆134Updated last year
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆123Updated last year
• graphcore / poplibs
  Poplar libraries
  ☆121Updated 2 years ago
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆78Updated 5 years ago
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆138Updated 11 months ago
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆268Updated this week
• lightsighter / CudaDMA
  Emulating DMA Engines on GPUs for Performance and Portability
  ☆41Updated 10 years ago
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆98Updated 5 months ago
• polymage-labs / mlirx
  MLIRX is now defunct. Please see PolyBlocks - https://docs.polymagelabs.com
  ☆38Updated 2 years ago
• mmperf / mmperf
  MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.
  ☆138Updated 2 years ago
• intel / tiny-tensor-compiler
  ☆19Updated last week
• tum-ei-eda / utvm_staticrt_codegen
  This project contains a code generator that produces static C NN inference deployment code targeting tiny micro-controllers (TinyML) as r…
  ☆29Updated 4 years ago
• google / mlir-npcomp
  npcomp - An aspirational MLIR based numpy compiler
  ☆51Updated 5 years ago
• uxlfoundation / oneCCL
  oneAPI Collective Communications Library (oneCCL)
  ☆252Updated last week
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆85Updated last week
• amd / ZenDNN
  ☆131Updated last week
• NVlabs / cub
  THIS REPOSITORY HAS MOVED TO github.com/nvidia/cub, WHICH IS AUTOMATICALLY MIRRORED HERE.
  ☆85Updated last year
• oneapi-src / Velocity-Bench
  ☆46Updated 2 weeks ago
• ROCm / rocMLIR
  ☆161Updated this week