Alternatives and similar repositories for inference-server:

Users that are interested in inference-server are comparing it to the libraries listed below

• Xilinx / ACCL
  Alveo Collective Communication Library: MPI-like communication operations for Xilinx Alveo accelerators
  ☆87Updated 5 months ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆138Updated 2 weeks ago
• AMDResearch / Riallto
  The Riallto Open Source Project from AMD
  ☆74Updated 4 months ago
• cupbop / CuPBoP
  A framework that support executing unmodified CUDA source code on non-NVIDIA devices.
  ☆115Updated 2 months ago
• amd / UIF
  ☆59Updated last year
• spcl / FBLAS
  BLAS implementation for Intel FPGA
  ☆76Updated 4 years ago
• oneapi-src / ishmem
  Intel® SHMEM - Device initiated shared memory based communication library
  ☆23Updated 4 months ago
• iree-org / iree-bare-metal-arm
  Example for running IREE in a bare-metal Arm environment.
  ☆31Updated 2 weeks ago
• spcl / mlir-dace
  Data-Centric MLIR dialect
  ☆40Updated last year
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆38Updated last month
• tenstorrent / tt-umd
  User-Mode Driver for Tenstorrent hardware
  ☆16Updated this week
• Xilinx / XRM
  XRM (Xilinx FPGA Resource Manager) Document:
  ☆23Updated last year
• Xilinx / mlir-air
  ☆90Updated this week
• openxla / shardy
  MLIR-based partitioning system
  ☆72Updated this week
• triSYCL / sycl
  SYCL for Vitis: Experimental fusion of triSYCL with Intel SYCL oneAPI DPC++ up-streaming effort into Clang/LLVM
  ☆115Updated 4 months ago
• NodLabs / mlir-examples
  a simple end to end example of taking a ML graph (TF2 / PyTorch) and running it on a device [cpu, gpu]
  ☆33Updated 4 years ago
• moritztng / grayskull-attention
  Attention in SRAM on Tenstorrent Grayskull
  ☆32Updated 7 months ago
• polymage-labs / mlirx
  MLIRX is now defunct. Please see PolyBlocks - https://docs.polymagelabs.com
  ☆38Updated last year
• lightsighter / CudaDMA
  Emulating DMA Engines on GPUs for Performance and Portability
  ☆38Updated 9 years ago
• Xilinx / pyxir
  ☆37Updated 2 years ago
• spcl / SMI
  Streaming Message Interface: High-Performance Distributed Memory Programming on Reconfigurable Hardware
  ☆16Updated 3 years ago
• intel / BaseKit-code-samples
  ☆55Updated 2 years ago
• ROCm / TransformerEngine
  ☆24Updated this week
• sandeepkumar-skb / pytorch_custom_op
  End to End steps for adding custom ops in PyTorch.
  ☆20Updated 4 years ago
• nod-ai / iree-amd-aie
  IREE plugin repository for the AMD AIE accelerator
  ☆83Updated this week
• NVIDIA / MagnumIO
  Magnum IO community repo
  ☆84Updated last month
• ROCm / rocWMMA
  rocWMMA
  ☆102Updated this week
• ucb-bar / onnxruntime-riscv
  Fork of upstream onnxruntime focused on supporting risc-v accelerators
  ☆83Updated last year
• ROCm / rocMLIR
  ☆137Updated this week
• ROCm / roctracer
  ROCm Tracer Callback/Activity Library for Performance tracing AMD GPUs
  ☆79Updated this week