awslabs / multi-model-serverLinks
Multi Model Server is a tool for serving neural net models for inference
☆1,012Updated last year
Alternatives and similar repositories for multi-model-server
Users that are interested in multi-model-server are comparing it to the libraries listed below
Sorting:
- Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.☆493Updated 2 years ago
- A low-latency prediction-serving system☆1,416Updated 4 years ago
- [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support☆289Updated 2 years ago
- Generic and easy-to-use serving service for machine learning models☆757Updated 3 months ago
- TensorFlow/TensorRT integration☆743Updated last year
- Machine Learning Model Deployment Made Simple☆719Updated 6 years ago
- Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https:…☆271Updated last month
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆173Updated last year
- Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors☆161Updated last year
- Library for exploring and validating machine learning data☆772Updated 2 weeks ago
- ONNXMLTools enables conversion of models to ONNX☆1,094Updated last month
- PyTorch on Kubernetes☆309Updated 3 years ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆89Updated 2 years ago
- A scalable inference server for models optimized with OpenVINO™☆742Updated this week
- Model analysis tools for TensorFlow☆1,268Updated last week
- PyTorch elastic training☆728Updated 3 years ago
- Open Source ML Model Versioning, Metadata, and Experiment Management☆1,727Updated 11 months ago
- Logging MXNet data for visualization in TensorBoard.☆325Updated 3 years ago
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,845Updated last year
- A curated list of MXNet examples, tutorials and blogs.☆835Updated 3 years ago
- Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and i…☆528Updated this week
- Natural language processing & computer vision models optimized for AWS☆141Updated 2 years ago
- Automated Machine Learning on Kubernetes☆1,607Updated last week
- WARNING: This package has been deprecated. Please use the SageMaker Training Toolkit for model training and the SageMaker Inference Toolk…☆186Updated 5 years ago
- Toolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://gith…☆203Updated last month
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆407Updated last year
- Tensorflow Backend for ONNX☆1,310Updated last year
- TFX is an end-to-end platform for deploying production ML pipelines☆2,149Updated 3 weeks ago
- Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO☆729Updated 3 weeks ago
- Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on K…☆692Updated 2 months ago