Alternatives and similar repositories for Simple-Inference-Server

Users that are interested in Simple-Inference-Server are comparing it to the libraries listed below

• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 7 months ago
• leimao / LibTorch-ResNet-CIFAR
  ResNet Implementation, Training, and Inference Using LibTorch C++ API
  ☆40Updated last year
• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 5 years ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆97Updated 7 months ago
• torchexpo / torchexpo
  Collection of models and extensions for deployment in PyTorch
  ☆24Updated 2 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• csukuangfj / OpenCNN
  An Open Convolutional Neural Network Framework in C++ From Scratch
  ☆64Updated 4 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• VoVAllen / tf-dlpack
  DLPack for Tensorflow
  ☆35Updated 5 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆54Updated 3 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆53Updated 2 years ago
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• jack-willturner / pytorch-onnx-tvm
  PyTorch -> ONNX -> TVM for autotuning
  ☆24Updated 5 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• adityaiitb / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆22Updated 2 years ago
• jongwook / tfrecord_lite
  Make TFRecord Usable Again
  ☆87Updated 2 years ago
• harvard-edge / dataperf-speech-example
  Example workflow for our data-centric speech benchmark
  ☆17Updated last year
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆60Updated last month
• npuichigo / blazing-fast-io-tutorial
  Blazing fast data loading with HuggingFace Dataset and Ray Data
  ☆16Updated last year
• helloall1900 / pynvx
  Python bindings for NVIDIA CUDA APIs.
  ☆12Updated last year
• masahi / torchscript-to-tvm
  ☆69Updated 2 years ago
• bwasti / pytorch_compiler_tutorial
  Codebase associated with the PyTorch compiler tutorial
  ☆46Updated 5 years ago
• guanh01 / CS692-mlsys
  This is the (evolving) reading list for the seminar.
  ☆59Updated 4 years ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆179Updated 5 months ago
• vadimkantorov / readaudio
  Read audio with FFmpeg into NumPy/PyTorch via ctypes (standard library module)
  ☆11Updated 4 years ago
• octoml / synr
  A library for syntactically rewriting Python programs, pronounced (sinner).
  ☆69Updated 3 years ago
• lernapparat / torchhacks
  Hacks for PyTorch
  ☆19Updated 2 years ago
• facebookresearch / FAMBench
  Benchmarks to capture important workloads.
  ☆31Updated 4 months ago