openvinotoolkit / model_serverLinks
A scalable inference server for models optimized with OpenVINO™
☆768Updated this week
Alternatives and similar repositories for model_server
Users that are interested in model_server are comparing it to the libraries listed below
Sorting:
- TensorFlow/TensorRT integration☆745Updated last year
- Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…☆719Updated this week
- DL Streamer is now part of Open Edge Platform, for latest updates and releases please visit new repo: https://github.com/open-edge-platfo…☆565Updated 2 months ago
- Repository for OpenVINO's extra modules☆141Updated this week
- Convert tf.keras/Keras models to ONNX☆381Updated 4 years ago
- ONNXMLTools enables conversion of models to ONNX☆1,113Updated 3 months ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆491Updated 3 weeks ago
- The framework to generate a Dockerfile, build, test, and deploy a docker image with OpenVINO™ toolkit.☆67Updated 2 weeks ago
- Dockerfiles and scripts for ONNX container images☆138Updated 3 years ago
- Tensorflow Backend for ONNX☆1,324Updated last year
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆648Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆496Updated this week
- OpenVINO™ integration with TensorFlow☆179Updated last year
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆211Updated 5 months ago
- Common source, scripts and utilities for creating Triton backends.☆347Updated 3 weeks ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆414Updated last week
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆644Updated last week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆342Updated this week
- A performant and modular runtime for TensorFlow☆760Updated 3 weeks ago
- Adlik: Toolkit for Accelerating Deep Learning Inference☆806Updated last year
- ONNX Optimizer☆757Updated 2 months ago
- Common utilities for ONNX converters☆281Updated 3 weeks ago
- Describes the full end to end smart parking application that is available with DeepStream 5.0☆348Updated last year
- Reference implementations of MLPerf™ inference benchmarks☆1,467Updated last week
- Neo-AI-DLR is a common runtime for machine learning models compiled by AWS SageMaker Neo, TVM, or TreeLite.☆497Updated 2 years ago
- Learn about the workflow using Intel® Distribution of OpenVINO™ toolkit to accelerate vision, automatic speech recognition, natural langu…☆301Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆139Updated 3 weeks ago
- Inference Model Manager for Kubernetes☆46Updated 6 years ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,083Updated this week
- Examples for using ONNX Runtime for model training.☆348Updated 11 months ago