Alternatives and similar repositories for model_server:

Users that are interested in model_server are comparing it to the libraries listed below

• intel / ai-reference-models
  Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…
  ☆711Updated this week
• tensorflow / tensorrt
  TensorFlow/TensorRT integration
  ☆742Updated last year
• intel / inference-model-manager
  Inference Model Manager for Kubernetes
  ☆46Updated 6 years ago
• dlstreamer / dlstreamer
  This repository is a home to Intel® Deep Learning Streamer (Intel® DL Streamer) Pipeline Framework. Pipeline Framework is a streaming med…
  ☆550Updated 2 weeks ago
• openvinotoolkit / nncf
  Neural Network Compression Framework for enhanced OpenVINO™ inference
  ☆1,004Updated this week
• intel / nauta
  A multi-user, distributed computing environment for running DL model training experiments on Intel® Xeon® Scalable processor-based system…
  ☆392Updated 11 months ago
• onnx / onnxmltools
  ONNXMLTools enables conversion of models to ONNX
  ☆1,074Updated 3 months ago
• dlstreamer / pipeline-server
  Home of Intel(R) Deep Learning Streamer Pipeline Server (formerly Video Analytics Serving)
  ☆126Updated last year
• openvinotoolkit / docker_ci
  The framework to generate a Dockerfile, build, test, and deploy a docker image with OpenVINO™ toolkit.
  ☆65Updated 3 weeks ago
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆268Updated this week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆460Updated this week
• openvinotoolkit / openvino_contrib
  Repository for OpenVINO's extra modules
  ☆119Updated 3 weeks ago
• onnx / keras-onnx
  Convert tf.keras/Keras models to ONNX
  ☆378Updated 3 years ago
• tensorflow / runtime
  A performant and modular runtime for TensorFlow
  ☆761Updated 2 weeks ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆318Updated last week
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆474Updated 2 weeks ago
• NVIDIA / tensorrt-laboratory
  Explore the Capabilities of the TensorRT Platform
  ☆264Updated 3 years ago
• open-edge-platform / training_extensions
  Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™
  ☆1,163Updated this week
• triton-inference-server / client
  Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.
  ☆620Updated last week
• open-edge-platform / geti-sdk
  Software Development Kit (SDK) for the Intel® Geti™ platform for Computer Vision AI model training.
  ☆87Updated this week
• onnx / optimizer
  ONNX Optimizer
  ☆700Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆268Updated 5 months ago
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆199Updated 2 weeks ago
• slyalin / openvino_devtools
  Tools for easier OpenVINO development/debugging
  ☆10Updated last month
• openvinotoolkit / openvino_tensorflow
  OpenVINO™ integration with TensorFlow
  ☆179Updated 10 months ago
• onnx / tensorflow-onnx
  Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX
  ☆2,409Updated 3 months ago
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆377Updated this week
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆132Updated last week
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆283Updated 2 years ago
• leimao / Frozen-Graph-TensorFlow
  Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x
  ☆302Updated 4 years ago