Alternatives and similar repositories for multi-model-server

Users that are interested in multi-model-server are comparing it to the libraries listed below

• neo-ai / neo-ai-dlr
  Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
  ☆497Updated 2 years ago
• ucbrise / clipper
  A low-latency prediction-serving system
  ☆1,421Updated 4 years ago
• oracle / graphpipe
  Machine Learning Model Deployment Made Simple
  ☆716Updated 7 years ago
• awslabs / keras-apache-mxnet
  [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support
  ☆288Updated 2 years ago
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,130Updated 3 weeks ago
• tensorflow / tensorrt
  TensorFlow/TensorRT integration
  ☆744Updated 2 years ago
• uber / petastorm
  Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…
  ☆1,870Updated last week
• aws / sagemaker-tensorflow-serving-container
  A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.
  ☆172Updated 2 years ago
• aws / sagemaker-tensorflow-training-toolkit
  Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https:…
  ☆270Updated 6 months ago
• VertaAI / modeldb
  Open Source ML Model Versioning, Metadata, and Experiment Management
  ☆1,744Updated last year
• tobegit3hub / simple_tensorflow_serving
  Generic and easy-to-use serving service for machine learning models
  ☆761Updated 9 months ago
• tensorflow / model-analysis
  Model analysis tools for TensorFlow
  ☆1,268Updated 4 months ago
• onnx / onnx-tensorflow
  Tensorflow Backend for ONNX
  ☆1,326Updated last year
• pytorch / elastic
  PyTorch elastic training
  ☆728Updated 3 years ago
• neo-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆90Updated 4 months ago
• aws / sagemaker-containers
  WARNING: This package has been deprecated. Please use the SageMaker Training Toolkit for model training and the SageMaker Inference Toolk…
  ☆187Updated 5 years ago
• google / ml-metadata
  For recording and retrieving metadata associated with ML developer and data scientist workflows.
  ☆667Updated 8 months ago
• tensorflow / data-validation
  Library for exploring and validating machine learning data
  ☆779Updated 6 months ago
• tensorflow / tfx
  TFX is an end-to-end platform for deploying production ML pipelines
  ☆2,168Updated this week
• IBM / FfDL
  Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on K…
  ☆692Updated 3 months ago
• aws / sagemaker-inference-toolkit
  Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.
  ☆410Updated 2 years ago
• tensorflow / io
  Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO
  ☆735Updated last month
• aws / sagemaker-pytorch-training-toolkit
  Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…
  ☆205Updated 4 months ago
• kubeflow / katib
  Automated Machine Learning on Kubernetes
  ☆1,648Updated last week
• tensorflow / transform
  Input pipeline framework
  ☆990Updated 4 months ago
• openvinotoolkit / model_server
  A scalable inference server for models optimized with OpenVINO™
  ☆805Updated this week
• aws-neuron / aws-neuron-sdk
  Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…
  ☆569Updated this week
• chinakook / Awesome-MXNet
  A curated list of MXNet examples, tutorials and blogs.
  ☆833Updated 3 years ago
• kubeflow / fairing
  Python SDK for building, training, and deploying ML models
  ☆337Updated 3 years ago
• kubeflow / pytorch-operator
  PyTorch on Kubernetes
  ☆309Updated 4 years ago