openvinotoolkit / model_server
A scalable inference server for models optimized with OpenVINO™
☆714Updated this week
Alternatives and similar repositories for model_server:
Users that are interested in model_server are comparing it to the libraries listed below
- Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…☆702Updated this week
- Inference Model Manager for Kubernetes☆46Updated 5 years ago
- A multi-user, distributed computing environment for running DL model training experiments on Intel® Xeon® Scalable processor-based system…☆392Updated 10 months ago
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,161Updated this week
- TensorFlow/TensorRT integration☆739Updated last year
- This repository is a home to Intel® Deep Learning Streamer (Intel® DL Streamer) Pipeline Framework. Pipeline Framework is a streaming med…☆544Updated last week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆986Updated this week
- Convert tf.keras/Keras models to ONNX☆379Updated 3 years ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆236Updated last week
- The framework to generate a Dockerfile, build, test, and deploy a docker image with OpenVINO™ toolkit.☆65Updated last month
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆449Updated this week
- Repository for OpenVINO's extra modules☆116Updated last week
- Software Development Kit (SDK) for the Intel® Geti™ platform for Computer Vision AI model training.☆78Updated this week
- ONNX Optimizer☆681Updated last week
- ONNXMLTools enables conversion of models to ONNX☆1,056Updated 2 months ago
- OpenVINO™ integration with TensorFlow☆179Updated 8 months ago
- Tensorflow Backend for ONNX☆1,296Updated 11 months ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆462Updated last week
- A performant and modular runtime for TensorFlow☆759Updated last month
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆611Updated this week
- Common source, scripts and utilities for creating Triton backends.☆310Updated this week
- Home of Intel(R) Deep Learning Streamer Pipeline Server (formerly Video Analytics Serving)☆126Updated last year
- Computation using data flow graphs for scalable machine learning☆67Updated this week
- Common utilities for ONNX converters☆259Updated 3 months ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆281Updated 2 years ago
- ☆28Updated last year
- Learn about the workflow using Intel® Distribution of OpenVINO™ toolkit to accelerate vision, automatic speech recognition, natural langu…☆303Updated 8 months ago
- Pre-trained Deep Learning models and demos (high quality and extremely fast)☆4,172Updated this week
- Reference implementations of MLPerf™ inference benchmarks☆1,331Updated last week
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆132Updated last week