Alternatives and similar repositories for Simple-Inference-Server

Users that are interested in Simple-Inference-Server are comparing it to the libraries listed below

• csukuangfj / OpenCNN
  An Open Convolutional Neural Network Framework in C++ From Scratch
  ☆66Updated 4 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• leimao / LibTorch-ResNet-CIFAR
  ResNet Implementation, Training, and Inference Using LibTorch C++ API
  ☆42Updated last year
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆97Updated 10 months ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆180Updated last month
• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 5 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆56Updated 3 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 10 months ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆54Updated 2 years ago
• adityaiitb / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆22Updated 3 years ago
• zhenhuaw-me / tflite
  Parse TFLite models (*.tflite) EASILY with Python. Check the API at https://zhenhuaw.me/tflite/docs/
  ☆102Updated 7 months ago
• larq / compute-engine
  Highly optimized inference engine for Binarized Neural Networks
  ☆251Updated 2 weeks ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆159Updated 3 weeks ago
• fumihwh / onnx-pytorch
  A code generator from ONNX to PyTorch code
  ☆139Updated 2 years ago
• Dynmi / AlexNet
  implement AlexNet with C / convolutional nerual network / machine learning / computer vision
  ☆191Updated 3 years ago
• graphcore / poptorch
  PyTorch interface for the IPU
  ☆180Updated last year
• pytorch / cppdocs
  PyTorch C++ API Documentation
  ☆234Updated last week
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆34Updated 2 years ago
• tigert1998 / qat
  Manually implemented quantization-aware training
  ☆21Updated 2 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆158Updated 3 weeks ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• onnx / onnx-xla
  XLA integration of Open Neural Network Exchange (ONNX)
  ☆19Updated 7 years ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆76Updated 3 weeks ago
• pytorch / extension-script
  Example repository for custom C++/CUDA operators for TorchScript
  ☆114Updated 3 years ago
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆363Updated 6 months ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆132Updated 3 years ago
• gpuopenanalytics / pynvml
  Provide Python access to the NVML library for GPU diagnostics
  ☆245Updated 8 months ago