Alternatives and similar repositories for torch-serving

Users that are interested in torch-serving are comparing it to the libraries listed below

• criteo / Spark-RSVD
  Randomized SVD of large sparse matrices on Spark
  ☆77Updated 3 years ago
• dhpollack / huggingface_libtorch
  Minimal example of using a traced huggingface transformers model with libtorch
  ☆36Updated 5 years ago
• Ximilar-com / tf-metric-learning
  Minimalistic TensorFlow2+ deep metric/similarity learning library with loss functions, miners, and utils as embedding projector.
  ☆38Updated 2 years ago
• etienne87 / pytorch-stream-dataloader
  ☆52Updated 2 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆72Updated 3 years ago
• markwwen / ServingAgent
  A simple middleware to improving GPU utilization then speedup online inference.
  ☆19Updated 4 years ago
• pfnet-research / menoh-java
  Building a Deep Neural Network (DNN) application in Java
  ☆11Updated 7 years ago
• Peter-Chou / libtorch_grpc_serving
  pytorch during training, libtorch during serving via gRPC
  ☆21Updated 6 years ago
• NervanaSystems / ngraph-mxnet
  MXNet - nGraph integration
  ☆34Updated 3 years ago
• criteo / deepr
  The deepr module provide abstractions (layers, readers, prepro, metrics, config) to help build tensorflow models on top of tf estimators
  ☆53Updated last year
• NVlabs / tensorcom
  ☆108Updated 4 years ago
• NegatioN / WARP-Pytorch
  WARP loss for Pytorch as described by the paper: WSABIE: Scaling Up To Large Vocabulary Image Annotation
  ☆44Updated 2 years ago
• soumyadipghosh / eventgrad
  Event-Triggered Communication in Parallel Machine Learning
  ☆30Updated 3 years ago
• divyekapoor / ml-op-benchmarks
  Benchmarks for Tensorflow and PyTorch Ops versus native code
  ☆13Updated last year
• karthikv2k / gpu_dbscan
  GPU version of DBSCAN using FB's faiss
  ☆52Updated 8 years ago
• mcarilli / mixed_precision_references
  Personal collection of references for high performance mixed precision training.
  ☆41Updated 5 years ago
• goldsborough / k-means
  Code accompanying my blog post on k-means in Python, C++ and CUDA
  ☆59Updated 8 years ago
• Abhijit-2592 / model-server
  gRPC server for hosting ML models trained on any framework in python
  ☆78Updated 2 months ago
• ray-project / ray_shuffling_data_loader
  A Ray-based data loader with per-epoch shuffling and configurable pipelining, for shuffling and loading training data for distributed tra…
  ☆18Updated 2 years ago
• facebookresearch / NasRec
  NASRec Weight Sharing Neural Architecture Search for Recommender Systems
  ☆31Updated last year
• rmit-ir / joint-cascade-ranking
  Joint Optimization of Cascade Ranking Models (WSDM 19)
  ☆13Updated 3 years ago
• cjermain / flink-onnx-pytorch
  Streaming machine learning using PyTorch, Flink, and ONNX
  ☆25Updated 4 years ago
• prajjwal1 / fluence
  A deep learning library based on Pytorch focussed on low resource language research and robustness
  ☆70Updated 3 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆34Updated 4 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated last year
• dlvu / vugrad
  Yet another mini autodiff system for educational purposes
  ☆30Updated 11 months ago
• jplu / faiss-grpc-server
  gRPC server over a FAISS index
  ☆19Updated 4 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 3 years ago
• sergey-serebryakov / tensorflow-internals
  It is open source ebook about TensorFlow kernel and implementation mechanism.
  ☆17Updated 6 years ago
• venkatacrc / PyTorchCppFrontEnd
  PyTorch 1.5 C++ frontend API
  ☆20Updated 5 years ago