awslabs / multi-model-server
Multi Model Server is a tool for serving neural net models for inference
☆1,008Updated 10 months ago
Alternatives and similar repositories for multi-model-server:
Users that are interested in multi-model-server are comparing it to the libraries listed below
- A low-latency prediction-serving system☆1,414Updated 3 years ago
- [DEPRECATED] Amazon Deep Learning's Keras with Apache MXNet support☆289Updated 2 years ago
- Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.☆494Updated last year
- Model analysis tools for TensorFlow☆1,262Updated 2 weeks ago
- Input pipeline framework☆987Updated 3 weeks ago
- A TensorFlow Serving solution for use in SageMaker. This repo is now deprecated.☆173Updated last year
- Machine Learning Model Deployment Made Simple☆719Updated 6 years ago
- Generic and easy-to-use serving service for machine learning models☆758Updated 3 weeks ago
- Amazon SageMaker Debugger provides functionality to save tensors during training of machine learning jobs and analyze those tensors☆161Updated 11 months ago
- Automated Machine Learning on Kubernetes☆1,566Updated this week
- Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet f…☆1,828Updated last year
- PyTorch elastic training☆730Updated 2 years ago
- Open Source ML Model Versioning, Metadata, and Experiment Management☆1,722Updated 8 months ago
- WARNING: This package has been deprecated. Please use the SageMaker Training Toolkit for model training and the SageMaker Inference Toolk…☆186Updated 4 years ago
- Logging MXNet data for visualization in TensorBoard.☆324Updated 3 years ago
- TensorFlow/TensorRT integration☆741Updated last year
- For recording and retrieving metadata associated with ML developer and data scientist workflows.☆644Updated last week
- Toolkit for running TensorFlow training scripts on SageMaker. Dockerfiles used for building SageMaker TensorFlow Containers are at https:…☆271Updated 2 months ago
- Fabric for Deep Learning (FfDL, pronounced fiddle) is a Deep Learning Platform offering TensorFlow, Caffe, PyTorch etc. as a Service on K…☆692Updated 2 years ago
- Facebook AI Performance Evaluation Platform☆390Updated 2 months ago
- Library for exploring and validating machine learning data☆769Updated last month
- Python SDK for building, training, and deploying ML models☆337Updated 3 years ago
- Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO☆724Updated this week
- Example for end-to-end machine learning on Kubernetes using Kubeflow and Seldon Core☆174Updated 3 years ago
- A multi-user, distributed computing environment for running DL model training experiments on Intel® Xeon® Scalable processor-based system…☆392Updated 11 months ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆90Updated 2 years ago
- Serve machine learning models within a 🐳 Docker container using 🧠 Amazon SageMaker.☆403Updated last year
- A scalable inference server for models optimized with OpenVINO™☆721Updated this week
- ONNXMLTools enables conversion of models to ONNX☆1,069Updated 3 months ago
- TFX is an end-to-end platform for deploying production ML pipelines☆2,142Updated 3 weeks ago