Alternatives and similar repositories for inference-server

Users that are interested in inference-server are comparing it to the libraries listed below

• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆84Updated 9 months ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆175Updated this week
• amd / UIF
  ☆60Updated 2 years ago
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆125Updated last year
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆119Updated this week
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆141Updated last year
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆273Updated last week
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆88Updated 2 years ago
• Xilinx / mlir-air
  ☆123Updated last week
• graphcore / poplibs
  Poplar libraries
  ☆122Updated 2 years ago
• ROCm / roctracer
  [DEPRECATED] Moved to ROCm/rocm-systems repo
  ☆84Updated 2 weeks ago
• Xilinx / pyxir
  ☆37Updated 3 years ago
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆101Updated 7 months ago
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆40Updated 6 months ago
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆78Updated 5 years ago
• intel / BaseKit-code-samples
  ☆55Updated 3 years ago
• tum-ei-eda / mlonmcu
  Tool for the deployment and analysis of TinyML applications on TFLM and MicroTVM backends
  ☆32Updated last week
• intel / npu-nn-cost-model
  Library for modelling performance costs of different Neural Network workloads on NPU devices
  ☆34Updated last month
• Xilinx / llvm-aie
  Fork of LLVM to support AMD AIEngine processors
  ☆187Updated this week
• WuDan0399 / Integrate-NVDLA-and-TVM
  ☆33Updated 2 years ago
• ROCm / rocMLIR
  ☆165Updated last week
• iml130 / mlir-emitc
  Conversions to MLIR EmitC
  ☆135Updated last year
• tum-ei-eda / utvm_staticrt_codegen
  This project contains a code generator that produces static C NN inference deployment code targeting tiny micro-controllers (TinyML) as r…
  ☆30Updated 4 years ago
• xmos / ai_tools
  AI applications and tools
  ☆30Updated last week
• unisa-hpc / sycl-bench
  SYCL Benchmark Suite
  ☆67Updated 7 months ago
• ROCm / hipBLAS
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆148Updated last week
• Zhao-Dongyu / sgemm_riscv
  This project records the process of optimizing SGEMM (single-precision floating point General Matrix Multiplication) on the riscv platfor…
  ☆24Updated last year
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆85Updated last month
• ROCm / hipTensor
  AMD’s C++ library for accelerating tensor primitives
  ☆49Updated last week
• ROCm / Tensile
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆254Updated last week