☆54Jul 16, 2026Updated this week
Alternatives and similar repositories for vllm-openvino
Users that are interested in vllm-openvino are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆557Updated this week
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆39Mar 12, 2026Updated 4 months ago
- SGLang kernel library for Intel XPU☆27Updated this week
- A curated list of OpenVINO based AI projects☆203May 18, 2026Updated 2 months ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆486Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆79May 27, 2026Updated last month
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆608Updated this week
- ☆430Updated this week
- A lightweight triton-based General Matrix Multiplication (GEMM) library.☆65Jun 13, 2026Updated last month
- OpenAI Triton backend for Intel® GPUs☆258Updated this week
- Run cpplint with reviewdog☆13Jun 21, 2026Updated last month
- Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon☆19Apr 20, 2026Updated 3 months ago
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆30Apr 16, 2026Updated 3 months ago
- ☆15Apr 11, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Developer kits reference setup scripts for various kinds of Intel platforms and GPUs☆49Updated this week
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 3 months ago
- Mini-Engine Demonstration of Combining XeSS with VRS Tier 2.☆14Jan 26, 2026Updated 5 months ago
- matmul using AMX instructions☆24May 7, 2024Updated 2 years ago
- ☆21Jul 3, 2024Updated 2 years ago
- This repository provides examples of PaddlePaddle and OpenVINO integration.☆23Mar 15, 2022Updated 4 years ago
- Repository for OpenVINO's extra modules☆180Updated this week
- DLL注入工具☆13Nov 9, 2020Updated 5 years ago
- Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apa…☆37Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ONNX Runtime: cross-platform, high performance scoring engine for ML models☆88Updated this week
- GPU Functional Descriptor for memory access☆34May 24, 2026Updated last month
- LCM OpenVINO model converter☆24Mar 27, 2024Updated 2 years ago
- OpenGL 学习代码☆15Jun 25, 2023Updated 3 years ago
- How to export PyTorch models with unsupported layers to ONNX and then to Intel OpenVINO☆28Feb 20, 2025Updated last year
- This is a clone of an SVN repository at http://pagecache-mangagement.googlecode.com/svn/trunk. It had been cloned by http://svn2github.co…☆10May 23, 2013Updated 13 years ago
- ☆15Jun 26, 2024Updated 2 years ago
- Meta project around MLIR☆46Updated this week
- Llama causal LM fully recreated in LibTorch. Designed to be used in Unreal Engine 5☆16Sep 19, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An Awesome list of oneAPI projects☆164Aug 8, 2025Updated 11 months ago
- Pre-built components and code samples to help you build and deploy production-grade AI applications with the OpenVINO™ Toolkit from Intel☆217Jul 6, 2026Updated 2 weeks ago
- Awesome list for baseband modem resources.☆13Jun 20, 2018Updated 8 years ago
- ☆180Updated this week
- ☆11Jan 7, 2023Updated 3 years ago
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆10,557Updated this week
- Software kit for Qualcomm Cloud AI 100☆19Dec 15, 2025Updated 7 months ago