Community maintained hardware plugin for vLLM on Intel Gaudi
☆68Nov 17, 2026Updated this week
Alternatives and similar repositories for vllm-gaudi
Users that are interested in vllm-gaudi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tested recipes, runtime fixes, kernels and fleet practices for serving LLMs with vLLM on Intel Gaudi☆11Oct 25, 2026Updated 3 weeks ago
- ☆16Jun 4, 2026Updated 5 months ago
- ☆20Oct 7, 2026Updated last month
- Guide to using an NVIDIA OAM adapter card to connect an Intel Gaudi2 to PCIe and get it properly driven and working under Ubuntu☆31Nov 4, 2026Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆92Nov 2, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi☆46Feb 3, 2025Updated last year
- SGLang kernel library for Intel XPU☆38Updated this week
- The world-first Pearl miner for Ascend NPU.☆10Jul 20, 2026Updated 3 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 10 months ago
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆212Updated this week
- ☆62Sep 14, 2026Updated 2 months ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区,聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆27Jul 2, 2026Updated 4 months ago
- The vLLM XPU kernels for Intel GPU☆83Updated this week
- Explore training for quantized models☆29Jul 12, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Provides the examples to write and build Habana custom kernels using the HabanaTools☆27Apr 15, 2025Updated last year
- ☆17Nov 12, 2026Updated last week
- ☆19Updated this week
- ☆27Oct 9, 2025Updated last year
- ☆13Feb 24, 2026Updated 8 months ago
- ☆122Updated this week
- fzf-based test selection with pytest☆16Jan 26, 2026Updated 9 months ago
- Software kit for Qualcomm Cloud AI 100 cc☆14Oct 8, 2026Updated last month
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆21Oct 16, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Nov 20, 2024Updated 2 years ago
- RTL-to-GDS: syn -> sta -> pnr -> gds☆15Sep 1, 2026Updated 2 months ago
- Open-source SM120 (Blackwell) SASS assembler — encode, schedule & assemble GPU machine code, including all tensor-core instructions.☆14Updated this week
- NVIDIA Linux open GPU with P2P support☆12Aug 2, 2026Updated 3 months ago
- ☆66Aug 6, 2026Updated 3 months ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆65May 27, 2026Updated 5 months ago
- This repository serves as a comprehensive collection of code examples, research papers, and practical resources from my Generative AI (Ge…☆12Oct 14, 2026Updated last month
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ,修改显卡显示名称为NVIDIA Tesla A100☆12Aug 30, 2026Updated 2 months ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- vLLM plugin for RBLN NPU☆61Updated this week
- ☆16Jun 17, 2025Updated last year
- Community maintained hardware plugin for vLLM on Spyre☆53Oct 1, 2026Updated last month
- PM Workshop China☆10Apr 11, 2019Updated 7 years ago
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆45Jul 22, 2026Updated 3 months ago
- Containerization and cloud native suite for OPEA☆75Oct 6, 2026Updated last month
- A simple way to bring drag’n’drop to flutter web☆34Jul 12, 2023Updated 3 years ago
Are these results useful?