Alternatives and similar repositories for multi-model-server

Users that are interested in multi-model-server are comparing it to the libraries listed below

• neo-ai / neo-ai-dlr
  Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
  ☆495Updated 2 years ago
• ucbrise / clipper
  A low-latency prediction-serving system
  ☆1,421Updated 4 years ago
• awslabs / keras-apache-mxnet
  [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support
  ☆289Updated 2 years ago
• oracle / graphpipe
  Machine Learning Model Deployment Made Simple
  ☆718Updated 6 years ago
• tensorflow / io
  Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO
  ☆733Updated this week
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,105Updated 2 months ago
• tensorflow / tensorrt
  TensorFlow/TensorRT integration
  ☆743Updated last year
• pytorch / elastic
  PyTorch elastic training
  ☆729Updated 3 years ago
• aws / sagemaker-tensorflow-serving-container
  A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.
  ☆172Updated last year
• tensorflow / transform
  Input pipeline framework
  ☆986Updated 2 weeks ago
• aws / sagemaker-tensorflow-training-toolkit
  Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https:…
  ☆271Updated 2 months ago
• tobegit3hub / simple_tensorflow_serving
  Generic and easy-to-use serving service for machine learning models
  ☆760Updated 5 months ago
• kubeflow / pytorch-operator
  PyTorch on Kubernetes
  ☆309Updated 3 years ago
• neo-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆89Updated last week
• awslabs / sagemaker-debugger
  Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors
  ☆162Updated last year
• tensorflow / model-analysis
  Model analysis tools for TensorFlow
  ☆1,269Updated 2 weeks ago
• aws / sagemaker-containers
  WARNING: This package has been deprecated. Please use the SageMaker Training Toolkit for model training and the SageMaker Inference Toolk…
  ☆186Updated 5 years ago
• kubeflow / katib
  Automated Machine Learning on Kubernetes
  ☆1,616Updated last week
• uber / petastorm
  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…
  ☆1,851Updated 2 weeks ago
• tensorflow / data-validation
  Library for exploring and validating machine learning data
  ☆773Updated 2 months ago
• VertaAI / modeldb
  Open Source ML Model Versioning, Metadata, and Experiment Management
  ☆1,734Updated last year
• aws-neuron / aws-neuron-sdk
  Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…
  ☆534Updated this week
• awslabs / mxboard
  Logging MXNet data for visualization in TensorBoard.
  ☆325Updated 3 years ago
• openvinotoolkit / model_server
  A scalable inference server for models optimized with OpenVINO™
  ☆751Updated this week
• aws / sagemaker-pytorch-training-toolkit
  Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…
  ☆204Updated 2 months ago
• tensorflow / tfx
  TFX is an end-to-end platform for deploying production ML pipelines
  ☆2,157Updated 2 months ago
• onnx / onnx-tensorflow
  Tensorflow Backend for ONNX
  ☆1,315Updated last year
• aws / sagemaker-inference-toolkit
  Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
  ☆407Updated last year
• chinakook / Awesome-MXNet
  A curated list of MXNet examples, tutorials and blogs.
  ☆835Updated 3 years ago
• IBM / FfDL
  Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on K…
  ☆692Updated 3 months ago