Alternatives and similar repositories for multi-model-server:

Users that are interested in multi-model-server are comparing it to the libraries listed below

• awslabs / keras-apache-mxnet
  [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support
  ☆289Updated 2 years ago
• oracle / graphpipe
  Machine Learning Model Deployment Made Simple
  ☆719Updated 6 years ago
• awslabs / mxboard
  Logging MXNet data for visualization in TensorBoard.
  ☆324Updated 3 years ago
• chinakook / Awesome-MXNet
  A curated list of MXNet examples, tutorials and blogs.
  ☆835Updated 2 years ago
• neo-ai / neo-ai-dlr
  Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
  ☆494Updated last year
• ucbrise / clipper
  A low-latency prediction-serving system
  ☆1,414Updated 3 years ago
• kubeflow / katib
  Automated Machine Learning on Kubernetes
  ☆1,545Updated 3 weeks ago
• tensorflow / tensorrt
  TensorFlow/TensorRT integration
  ☆739Updated last year
• tensorflow / model-analysis
  Model analysis tools for TensorFlow
  ☆1,262Updated 3 weeks ago
• tobegit3hub / simple_tensorflow_serving
  Generic and easy-to-use serving service for machine learning models
  ☆757Updated 4 years ago
• pytorch / elastic
  PyTorch elastic training
  ☆730Updated 2 years ago
• awslabs / sagemaker-debugger
  Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors
  ☆161Updated 10 months ago
• facebookincubator / gloo
  Collective communications library with various primitives for multi-machine training.
  ☆1,273Updated this week
• baidu-research / baidu-allreduce
  ☆577Updated 6 years ago
• VertaAI / modeldb
  Open Source ML Model Versioning, Metadata, and Experiment Management
  ☆1,718Updated 7 months ago
• aws / sagemaker-inference-toolkit
  Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
  ☆399Updated last year
• pytorch / tvm
  TVM integration into PyTorch
  ☆452Updated 5 years ago
• neo-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆91Updated 2 years ago
• tensorflow / runtime
  A performant and modular runtime for TensorFlow
  ☆759Updated 2 weeks ago
• uber / petastorm
  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…
  ☆1,821Updated last year
• mlcommons / training
  Reference implementations of MLPerf™ training benchmarks
  ☆1,648Updated last month
• uber / neuropod
  A uniform interface to run deep learning models from multiple frameworks
  ☆936Updated last year
• PaddlePaddle / Anakin
  High performance Cross-platform Inference-engine, you could run Anakin on x86-cpu,arm, nv-gpu, amd-gpu,bitmain and cambricon devices.
  ☆533Updated 2 years ago
• baidu-research / tensorflow-allreduce
  ☆372Updated 7 years ago
• dmlc / dmlc-core
  A common bricks library for building scalable and portable distributed machine learning.
  ☆867Updated 8 months ago
• dmlc / nnvm
  ☆1,657Updated 6 years ago
• kubeflow / fairing
  Python SDK for building, training, and deploying ML models
  ☆336Updated 2 years ago
• facebook / FAI-PEP
  Facebook AI Performance Evaluation Platform
  ☆390Updated last month
• kubeflow / pytorch-operator
  PyTorch on Kubernetes
  ☆308Updated 3 years ago
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,055Updated 2 months ago