awslabs / multi-model-serverLinks
Multi Model Server is a tool for serving neural net models for inference
☆1,025Updated last year
Alternatives and similar repositories for multi-model-server
Users that are interested in multi-model-server are comparing it to the libraries listed below
Sorting:
- Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.☆497Updated 2 years ago
- A low-latency prediction-serving system☆1,421Updated 4 years ago
- Generic and easy-to-use serving service for machine learning models☆761Updated 10 months ago
- [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support☆288Updated 2 years ago
- TensorFlow/TensorRT integration☆743Updated 2 years ago
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆172Updated 2 years ago
- Machine Learning Model Deployment Made Simple☆716Updated 7 years ago
- Model analysis tools for TensorFlow☆1,267Updated 5 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆90Updated 5 months ago
- Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO☆735Updated last month
- A curated list of MXNet examples, tutorials and blogs.☆834Updated 3 years ago
- Input pipeline framework☆990Updated 5 months ago
- Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https:…☆271Updated 7 months ago
- Open Source ML Model Versioning, Metadata, and Experiment Management☆1,744Updated last year
- A scalable inference server for models optimized with OpenVINO™☆816Updated last week
- WARNING: This package has been deprecated. Please use the SageMaker Training Toolkit for model training and the SageMaker Inference Toolk…☆187Updated 5 years ago
- Visual Search using Apache MXNet and gluon☆239Updated 7 years ago
- Automated Machine Learning on Kubernetes☆1,652Updated this week
- TFX is an end-to-end platform for deploying production ML pipelines☆2,170Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,873Updated 2 weeks ago
- A performant and modular runtime for TensorFlow☆755Updated 4 months ago
- Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors☆164Updated last year
- Library for exploring and validating machine learning data☆779Updated 6 months ago
- Logging MXNet data for visualization in TensorBoard.☆324Updated 4 years ago
- ONNXMLTools enables conversion of models to ONNX☆1,134Updated this week
- Tensorflow Backend for ONNX☆1,325Updated last year
- PyTorch elastic training☆728Updated 3 years ago
- Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on K…☆692Updated 4 months ago
- A benchmark framework for Tensorflow☆1,145Updated 2 years ago
- A Redis module for serving tensors and executing deep learning graphs☆841Updated 5 months ago