Alternatives and similar repositories for inference-server

Users that are interested in inference-server are comparing it to the libraries listed below

• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆149Updated 2 weeks ago
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆81Updated 3 months ago
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆98Updated this week
• Xilinx / llvm-aie
  Fork of LLVM to support AMD AIEngine processors
  ☆152Updated this week
• amd / UIF
  ☆60Updated last year
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆42Updated 5 months ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆43Updated 4 months ago
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆96Updated 2 weeks ago
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆131Updated 6 months ago
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆77Updated 4 years ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆88Updated 2 years ago
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆51Updated 11 months ago
• ROCm / roctracer
  ROCm Tracer Callback/Activity Library for Performance tracing AMD GPUs
  ☆84Updated last week
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆120Updated 8 months ago
• Xilinx / mlir-air
  ☆102Updated this week
• ROCm / rocMLIR
  ☆148Updated this week
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆84Updated last year
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆230Updated this week
• uxlfoundation / oneapi-construction-kit
  ☆86Updated this week
• polymage-labs / mlirx
  MLIRX is now defunct. Please see PolyBlocks - https://docs.polymagelabs.com
  ☆38Updated last year
• Xilinx / pyxir
  ☆37Updated 3 years ago
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆110Updated this week
• NodLabs / mlir-examples
  a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]
  ☆35Updated 4 years ago
• ROCm / hipBLAS
  ROCm BLAS marshalling library
  ☆144Updated this week
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆60Updated this week
• intel / BaseKit-code-samples
  ☆55Updated 2 years ago
• ROCm / MISA
  Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)
  ☆34Updated last week
• openxla / shardy
  MLIR-based partitioning system
  ☆103Updated this week
• spcl / mlir-dace
  Data-Centric MLIR dialect
  ☆42Updated last year
• intel / npu-nn-cost-model
  Library for modelling performance costs of different Neural Network workloads on NPU devices
  ☆34Updated last month