☆59Sep 14, 2026Updated this week
Alternatives and similar repositories for vllm-openvino
Users that are interested in vllm-openvino are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenVINO Tokenizers extension☆57Updated this week
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated last year
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆588Updated this week
- Community maintained hardware plugin for vLLM on Intel Gaudi☆57Updated this week
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆41Sep 1, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- SGLang kernel library for Intel XPU☆35Updated this week
- go-onedrive is a Go client library for accessing the Microsoft OneDrive API.☆10Dec 12, 2018Updated 7 years ago
- OpenVINO Intel NPU Compiler☆100Updated this week
- ☆18Sep 8, 2026Updated last week
- A curated list of OpenVINO based AI projects☆209May 18, 2026Updated 4 months ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆525Updated this week
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆79Sep 8, 2026Updated last week
- OpenVINO Post-Training Optimization Toolkit Tutorial☆17Sep 28, 2020Updated 5 years ago
- ☆536Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A lightweight triton-based General Matrix Multiplication (GEMM) library.☆68Jul 21, 2026Updated last month
- Official Code Repo for《OpenVINO工具套件权威指南》☆25Aug 9, 2025Updated last year
- OpenAI Triton backend for Intel® GPUs☆271Updated this week
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆17Feb 21, 2026Updated 6 months ago
- Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon☆19Apr 20, 2026Updated 5 months ago
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆31Apr 16, 2026Updated 5 months ago
- Developer kits reference setup scripts for various kinds of Intel platforms and GPUs☆54Updated this week
- A Gradio Web UI for running local LLM on Intel GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max) using IPEX-LLM.☆17Sep 13, 2026Updated last week
- ☆113Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- The AI PC Application Installer provides a unified way to set up Intel AI PC development environments.☆43Jul 23, 2026Updated last month
- PM Workshop China☆10Apr 11, 2019Updated 7 years ago
- ☆21Jul 3, 2024Updated 2 years ago
- Benchmark Suite Invocation Scripting☆11Mar 16, 2022Updated 4 years ago
- ☆15May 8, 2025Updated last year
- Google DeepMind: Mixture of Depths Unofficial Implementation.☆12May 29, 2024Updated 2 years ago
- DLL注入工具☆13Nov 9, 2020Updated 5 years ago
- Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apa…☆36Aug 10, 2026Updated last month
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆39Aug 25, 2026Updated 3 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- GPU Functional Descriptor for memory access☆34May 24, 2026Updated 3 months ago
- OpenGL 学习代码☆15Jun 25, 2023Updated 3 years ago
- An Awesome list of oneAPI projects☆166Aug 8, 2025Updated last year
- Llama causal LM fully recreated in LibTorch. Designed to be used in Unreal Engine 5☆16Sep 19, 2024Updated 2 years ago
- Pre-built components and code samples to help you build and deploy production-grade AI applications with the OpenVINO™ Toolkit from Intel☆217Jul 30, 2026Updated last month
- ☆15Jun 26, 2024Updated 2 years ago
- Unreal Engine 5 3D Platformer game prototype☆21May 27, 2024Updated 2 years ago