Alternatives and similar repositories for model_server

Users that are interested in model_server are comparing it to the libraries listed below

• intel / ai-reference-models
  Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…
  ☆727Updated 2 weeks ago
• tensorflow / tensorrt
  TensorFlow/TensorRT integration
  ☆743Updated 2 years ago
• openvinotoolkit / openvino_contrib
  Repository for OpenVINO's extra modules
  ☆162Updated last week
• open-edge-platform / dlstreamer
  Deep Learning Streamer (DL Streamer) Pipeline Framework is an open-source streaming media analytics framework, based on GStreamer* multim…
  ☆582Updated this week
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆503Updated this week
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,139Updated last week
• openvinotoolkit / openvino_tensorflow
  OpenVINO™ integration with TensorFlow
  ☆180Updated last year
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆428Updated this week
• openvinotoolkit / docker_ci
  The framework to generate a Dockerfile, build, test, and deploy a docker image with OpenVINO™ toolkit.
  ☆70Updated last week
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆366Updated this week
• onnx / keras-onnx
  Convert tf.keras/Keras models to ONNX
  ☆382Updated 4 years ago
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆532Updated this week
• onnx / onnx-docker
  Dockerfiles and scripts for ONNX container images
  ☆138Updated 3 years ago
• onnx / onnx-tensorflow
  Tensorflow Backend for ONNX
  ☆1,325Updated last year
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆293Updated last month
• triton-inference-server / client
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆677Updated last week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆216Updated last week
• openvinotoolkit / nncf
  Neural Network Compression Framework for enhanced OpenVINO™ inference
  ☆1,123Updated this week
• open-edge-platform / training_extensions
  Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
  ☆1,216Updated this week
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆140Updated last week
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆441Updated this week
• intel / inference-model-manager
  Inference Model Manager for Kubernetes
  ☆46Updated 6 years ago
• onnx / tensorflow-onnx
  Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX
  ☆2,514Updated 4 months ago
• neo-ai / neo-ai-dlr
  Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.
  ☆497Updated 2 years ago
• intel / intel-extension-for-pytorch
  A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
  ☆2,008Updated 2 weeks ago
• onnx / optimizer
  ONNX Optimizer
  ☆795Updated last week
• triton-inference-server / python_backend
  Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.
  ☆667Updated last week
• microsoft / onnxruntime-training-examples
  Examples for using ONNX Runtime for model training.
  ☆361Updated last year
• mlcommons / inference
  Reference implementations of MLPerf® inference benchmarks
  ☆1,525Updated this week
• awslabs / multi-model-server
  Multi Model Server is a tool for serving neural net models for inference
  ☆1,024Updated last year