Alternatives and similar repositories for Simple-Inference-Server:

Users that are interested in Simple-Inference-Server are comparing it to the libraries listed below

• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 4 months ago
• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 5 years ago
• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆43Updated last week
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆64Updated 2 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• leimao / LibTorch-ResNet-CIFAR
  ResNet Implementation, Training, and Inference Using LibTorch C++ API
  ☆39Updated 8 months ago
• usyd-fsalab / NeuralNetworkRandomness
  ☆14Updated 2 years ago
• intel / optimized-models
  ☆26Updated 2 years ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• torchexpo / torchexpo
  Collection of models and extensions for deployment in PyTorch
  ☆24Updated 2 years ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆96Updated 3 months ago
• feifeibear / PyTorchMemTracer
  Depict GPU memory footprint during DNN training of PyTorch
  ☆11Updated 2 years ago
• VoVAllen / tf-dlpack
  DLPack for Tensorflow
  ☆36Updated 4 years ago
• adityaiitb / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆22Updated 2 years ago
• pytorch / extension-script
  Example repository for custom C++/CUDA operators for TorchScript
  ☆115Updated 2 years ago
• Chillee / CS344_2021
  Udacity CS344 Introduction to Parallell Programming (https://classroom.udacity.com/courses/cs344), with assignments/materials updated to …
  ☆46Updated 3 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆84Updated last year
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• zdevito / custom_loader
  ☆12Updated 3 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆52Updated 2 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 11 months ago
• NVIDIA / DALI_extra
  Test data for DALI project
  ☆41Updated last week
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆26Updated 4 years ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆178Updated 2 months ago
• bwasti / pytorch_compiler_tutorial
  Codebase associated with the PyTorch compiler tutorial
  ☆44Updated 5 years ago
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated last year