☆56Jul 16, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm-openvino
Users that are interested in vllm-openvino are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OpenVINO Tokenizers extension☆55Updated this week
- Edge Insights for Vision (eiv) is a package that helps to auto install Intel® GPU drivers and setup environment for Inference application…☆22Sep 29, 2025Updated 10 months ago
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated last year
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆567Updated this week
- SGLang kernel library for Intel XPU☆29Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- OpenVINO Intel NPU Compiler☆92Updated this week
- go-onedrive is a Go client library for accessing the Microsoft OneDrive API.☆10Dec 12, 2018Updated 7 years ago
- ☆18Jul 23, 2026Updated 2 weeks ago
- Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.☆498Aug 3, 2026Updated last week
- This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …☆79May 27, 2026Updated 2 months ago
- ☆462Updated this week
- A lightweight triton-based General Matrix Multiplication (GEMM) library.☆67Jul 21, 2026Updated 2 weeks ago
- OpenAI Triton backend for Intel® GPUs☆264Updated this week
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆15Feb 21, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Run cpplint with reviewdog☆13Updated this week
- Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon☆19Apr 20, 2026Updated 3 months ago
- Add genai backend for ollama to run generative AI models using OpenVINO Runtime.☆31Apr 16, 2026Updated 3 months ago
- ☆15Apr 11, 2024Updated 2 years ago
- Developer kits reference setup scripts for various kinds of Intel platforms and GPUs☆50Updated this week
- ☆19Dec 23, 2025Updated 7 months ago
- Mini-Engine Demonstration of Combining XeSS with VRS Tier 2.☆14Jan 26, 2026Updated 6 months ago
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 3 months ago
- ☆101Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This repository provides examples of PaddlePaddle and OpenVINO integration.☆23Mar 15, 2022Updated 4 years ago
- DLL注入工具☆13Nov 9, 2020Updated 5 years ago
- matmul using AMX instructions☆24May 7, 2024Updated 2 years ago
- SPDK fork of nvme-cli. No longer supported - use standard nvme-cli with SPDK nvme CUSE instead. See https://spdk.io/doc/nvme.html#nvme_…☆15Apr 10, 2024Updated 2 years ago
- Deep Learning Inference benchmark. Supports OpenVINO™ toolkit, TensorFlow, TensorFlow Lite, ONNX Runtime, OpenCV DNN, MXNet, PyTorch, Apa…☆37Jul 28, 2026Updated 2 weeks ago
- ONNX Runtime: cross-platform, high performance scoring engine for ML models☆89Updated this week
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆26Jul 2, 2026Updated last month
- GPU Functional Descriptor for memory access☆34May 24, 2026Updated 2 months ago
- ☆24Mar 26, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- This is a clone of an SVN repository at http://pagecache-mangagement.googlecode.com/svn/trunk. It had been cloned by http://svn2github.co…☆10May 23, 2013Updated 13 years ago
- An Awesome list of oneAPI projects☆164Aug 8, 2025Updated last year
- ☆15Jun 26, 2024Updated 2 years ago
- Meta project around MLIR☆48Updated this week
- Awesome list for baseband modem resources.☆13Jun 20, 2018Updated 8 years ago
- ☆11Jan 7, 2023Updated 3 years ago
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆10,634Updated this week