openvinotoolkit / operator
OpenVINO operator for OpenShift and Kubernetes
☆14Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for operator
- A scalable inference server for models optimized with OpenVINO™☆676Updated this week
- Run cloud native workloads on NVIDIA GPUs☆135Updated last week
- Inference Model Manager for Kubernetes☆46Updated 5 years ago
- Controller for ModelMesh☆205Updated 4 months ago
- Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…☆683Updated this week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆185Updated 2 months ago
- OpenVINO Tokenizers extension☆25Updated this week
- OpenVINO backend for Triton.☆30Updated this week
- oneAPI Collective Communications Library (oneCCL)☆206Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆434Updated this week
- MIG Partition Editor for NVIDIA GPUs☆174Updated this week
- A multi-user, distributed computing environment for running DL model training experiments on Intel® Xeon® Scalable processor-based system…☆392Updated 6 months ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆155Updated this week
- The framework to generate a Dockerfile, build, test, and deploy a docker image with OpenVINO™ toolkit.☆60Updated last week
- Distributed Model Serving Framework☆154Updated last month
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆24Updated 3 months ago
- The Triton backend for the ONNX Runtime.☆133Updated this week
- Computation using data flow graphs for scalable machine learning☆67Updated this week
- ModelMesh Performance Scripts, Dashboard and Pipelines☆11Updated 2 years ago
- Software Development Kit (SDK) for the Intel® Geti™ platform for Computer Vision AI model training.☆75Updated this week
- Common source, scripts and utilities for creating Triton backends.☆295Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆78Updated this week
- Repository for OpenVINO's extra modules☆106Updated 2 weeks ago
- Libraries and tools to support Transfer Learning☆18Updated last month
- ☆19Updated 11 months ago
- OpenVINO™ integration with TensorFlow☆178Updated 4 months ago
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆21Updated this week
- GPU plugin to the node feature discovery for Kubernetes☆292Updated 5 months ago
- Splits single Nvidia GPU into multiple partitions with complete compute and memory isolation (wrt to performace) between the partitions☆153Updated 5 years ago
- Intent Driven Orchestration enables management of applications through their Service Level Objectives, while minimizing developer and adm…☆34Updated 2 months ago