Alternatives and similar repositories for inference-server:

Users that are interested in inference-server are comparing it to the libraries listed below

• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆71Updated 2 months ago
• amd / UIF
  ☆58Updated last year
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆134Updated this week
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆115Updated 2 months ago
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆26Updated 2 weeks ago
• oneapi-src / DPCPP_Reference
  oneAPI Data Parallel C++ (DPC++) language reference
  ☆24Updated 2 years ago
• tlc-pack / tlcpack
  ☆23Updated 11 months ago
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆73Updated this week
• intel / BaseKit-code-samples
  ☆55Updated 2 years ago
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆76Updated 4 years ago
• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆85Updated 3 months ago
• Xilinx / pyxir
  ☆37Updated 2 years ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆87Updated 6 months ago
• ROCm / rocMLIR
  ☆134Updated this week
• ROCm / MISA
  Machine Intelligence Shader Autogen. AMDGPU ML shader code generator. (previously iGEMMgen)
  ☆34Updated 4 months ago
• spcl / mlir-dace
  Data-Centric MLIR dialect
  ☆40Updated last year
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆51Updated 5 months ago
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆83Updated last year
• microsoft / dist-ir
  An IR for efficiently simulating distributed ML computation.
  ☆25Updated last year
• oneapi-src / ishmem
  Intel® SHMEM - Device initiated shared memory based communication library
  ☆22Updated 2 months ago
• escalab / GPTPU
  GPTPU for SC 2021
  ☆51Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• ROCm / rocm_bandwidth_test
  Bandwidth test for ROCm
  ☆53Updated this week
• openxla / shardy
  MLIR-based partitioning system
  ☆58Updated this week
• NodLabs / mlir-examples
  a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]
  ☆29Updated 4 years ago
• xmos / ai_tools
  AI applications and tools
  ☆26Updated this week
• lightsighter / CudaDMA
  Emulating DMA Engines on GPUs for Performance and Portability
  ☆35Updated 9 years ago
• ROCm / Tensile
  Stretching GPU performance for GEMMs and tensor contractions.
  ☆231Updated this week
• KhronosGroup / SYCL_Reference
  SYCL Reference Manual
  ☆27Updated 9 months ago
• ROCm / roctracer
  ROCm Tracer Callback/Activity Library for Performance tracing AMD GPUs
  ☆79Updated this week