awslabs / multi-model-serverLinks
Multi Model Server is a tool for serving neural net models for inference
☆1,024Updated last year
Alternatives and similar repositories for multi-model-server
Users that are interested in multi-model-server are comparing it to the libraries listed below
Sorting:
- Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.☆497Updated 2 years ago
- A low-latency prediction-serving system☆1,417Updated 4 years ago
- [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support☆289Updated 2 years ago
- TensorFlow/TensorRT integration☆744Updated last year
- Machine Learning Model Deployment Made Simple☆717Updated 7 years ago
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆172Updated 2 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,867Updated 2 weeks ago
- Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO☆734Updated 2 months ago
- Model analysis tools for TensorFlow☆1,268Updated 3 months ago
- Open Source ML Model Versioning, Metadata, and Experiment Management☆1,741Updated last year
- Facebook AI Performance Evaluation Platform☆391Updated this week
- Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors☆162Updated last year
- A curated list of MXNet examples, tutorials and blogs.☆834Updated 3 years ago
- PyTorch elastic training☆730Updated 3 years ago
- Library for exploring and validating machine learning data☆778Updated 4 months ago
- Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https:…☆270Updated 5 months ago
- Generic and easy-to-use serving service for machine learning models☆761Updated 8 months ago
- Input pipeline framework☆989Updated 3 months ago
- WARNING: This package has been deprecated. Please use the SageMaker Training Toolkit for model training and the SageMaker Inference Toolk…☆185Updated 5 years ago
- Logging MXNet data for visualization in TensorBoard.☆324Updated 3 years ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆409Updated 2 years ago
- Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on K…☆692Updated 2 months ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆205Updated 2 months ago
- TFX is an end-to-end platform for deploying production ML pipelines☆2,169Updated 3 weeks ago
- A scalable inference server for models optimized with OpenVINO™☆790Updated this week
- ONNXMLTools enables conversion of models to ONNX☆1,124Updated 5 months ago
- For recording and retrieving metadata associated with ML developer and data scientist workflows.☆666Updated 7 months ago
- Collective communications library with various primitives for multi-machine training.☆1,369Updated 3 weeks ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆553Updated last week
- A benchmark framework for Tensorflow☆1,148Updated 2 years ago