Alternatives and similar repositories for inference-server

Users that are interested in inference-server are comparing it to the libraries listed below

• amd / UIF
  ☆60Updated last year
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆81Updated 2 months ago
• xmos / ai_tools
  AI applications and tools
  ☆29Updated 2 weeks ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆150Updated this week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆43Updated 3 months ago
• intel / tiny-tensor-compiler
  ☆17Updated this week
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆95Updated last week
• Xilinx / pyxir
  ☆37Updated 3 years ago
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆42Updated 4 months ago
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆78Updated 4 years ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated last month
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆50Updated 10 months ago
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆58Updated last month
• polymage-labs / mlirx
  MLIRX is now defunct. Please see PolyBlocks - https://docs.polymagelabs.com
  ☆38Updated last year
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆119Updated 7 months ago
• ROCm / MISA
  Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)
  ☆34Updated 2 weeks ago
• eembc / mlmark
  EEMBC's Machine-Learning Inference Benchmark targeted at edge devices.
  ☆48Updated 3 years ago
• google / mlir-npcomp
  npcomp - An aspirational MLIR based numpy compiler
  ☆51Updated 4 years ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆51Updated this week
• amd / ZenDNN
  ☆108Updated last week
• ROCm / TransformerEngine
  ☆38Updated this week
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆97Updated this week
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆99Updated 11 months ago
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆130Updated 5 months ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆87Updated 2 years ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated last week
• KhronosGroup / SYCL_Reference
  SYCL Reference Manual
  ☆28Updated last year
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆35Updated 3 months ago
• spcl / mlir-dace
  Data-Centric MLIR dialect
  ☆42Updated last year
• heterosys / mlir-vitis
  📥 🎯 (1,4/4) an MLIR-based toolchain with Vitis HLS LLVM input/output targeting FPGAs.
  ☆14Updated 2 years ago