Alternatives and similar repositories for inference-server:

Users that are interested in inference-server are comparing it to the libraries listed below

• amd / UIF
  ☆59Updated last year
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆141Updated last week
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆87Updated 5 months ago
• ROCm / TransformerEngine
  ☆25Updated this week
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆75Updated 4 months ago
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆60Updated last week
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆77Updated 4 years ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆91Updated 8 months ago
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆81Updated this week
• xmos / ai_tools
  AI applications and tools
  ☆26Updated last week
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆54Updated last week
• lightsighter / CudaDMA
  Emulating DMA Engines on GPUs for Performance and Portability
  ☆39Updated 9 years ago
• ROCm / MISA
  Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)
  ☆34Updated this week
• ROCm / rocSHMEM
  rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.
  ☆63Updated this week
• ROCm / rocMLIR
  ☆138Updated this week
• escalab / GPTPU
  GPTPU for SC 2021
  ☆51Updated 2 years ago
• spcl / mlir-dace
  Data-Centric MLIR dialect
  ☆40Updated last year
• google / mlir-npcomp
  npcomp - An aspirational MLIR based numpy compiler
  ☆51Updated 4 years ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆83Updated last year
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆84Updated this week
• Xilinx / mlir-air
  ☆90Updated this week
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆115Updated 2 months ago
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆115Updated 4 months ago
• stanford-ppl / spatial-multiverse
  Provides Spatial with front-end support from popular machine learning frameworks
  ☆33Updated 5 years ago
• lixiuhong / batched_gemm
  ☆39Updated 5 years ago
• ROCm / rocWMMA
  rocWMMA
  ☆102Updated this week
• openxla / shardy
  MLIR-based partitioning system
  ☆73Updated this week
• ROCm / hipSPARSE
  ROCm SPARSE marshalling library
  ☆67Updated this week
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆82Updated last year
• dimdano / faiss-fpga
  An FPGA integration and acceleration of the popular FAISS framework for approximate similarity search
  ☆23Updated 5 years ago