Dogfooding vLLM backport for older GPUs.
☆14Oct 29, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm-backport
Users that are interested in vllm-backport are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- dsv41-flash-pp5-170hx &pp6 Supports the original (full/unquantized) model. Prefill 7,000 t/s, decode 45-75-125 t/s. dspark. Requires 200 …☆13Updated this week
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ,修改显卡显示名称为NVIDIA Tesla A100☆12Aug 30, 2026Updated 2 months ago
- Qwen3.8-Flash-Next-FP8 (official checkpoint) on 3x/4x CMP170HX / PP=4 / MTP-4☆12Updated this week
- 双 SM80 / CMP 170HX 的 Qwen3.8-Flash-Next 社区 vLLM:NVIDIA NVFP4、GDS、TEP2、MTP6,支持 1~10 并发,词表与 PCIe 通信优化。中英文部署与可构建源码。☆28Oct 15, 2026Updated last month
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- DeepSeek-V4.1-Flash (764B) on 4×CMP 170HX: PP4 + shadow KV + EXL3 2bpw + DSpark + 512k ctx + native vision — patches, recipes, acceptance…☆15Sep 29, 2026Updated last month
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆32Nov 2, 2026Updated 2 weeks ago
- ☆36Oct 20, 2026Updated 3 weeks ago
- some experiments about 170hx 10g version.☆14Oct 19, 2026Updated last month
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆120Aug 13, 2026Updated 3 months ago
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated 2 months ago
- A fork of jasl/vllm (codex/ds4-sm120-min-enable) with CPU-GPU hybrid inference support for DeepSeek-V4 on SM120+.☆32Sep 10, 2026Updated 2 months ago
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- finetune the chain model based on cvte open source model without traing any GMM for frame alignment☆12Aug 6, 2020Updated 6 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Nov 4, 2026Updated 2 weeks ago
- The complete NUMA-optimized branch of the ktransformers project☆27Nov 3, 2025Updated last year
- defeating fuse security on ga100 with pico 2(and some wires)☆129Updated this week
- 1Cat-vLLM on Intel Gaudi☆48Oct 12, 2026Updated last month
- A tool to unlobotomize your NVIDIA card!☆925Oct 28, 2026Updated 3 weeks ago
- AI Prompt Factory - Automated High-Quality Prompt Suite Generation After the system runs, various roles required by agents will be creat…☆19Dec 20, 2025Updated 10 months ago
- simple repository with CI enabled☆13Apr 10, 2025Updated last year
- Active4j-jsp是基于SpingBoot2.0轻量级的java快速开发框架。以Spring Framework为核心容器,Spring MVC为模型视图控制器,Mybatis Plus为数据访问层, Apache Shiro为权限授权层, Redis为分布式缓存,Q…☆15Feb 11, 2026Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- The original as far as I could find.☆14Feb 10, 2025Updated last year
- yt-dlp+Aria2+WebUI container with Rclone auto-upload function & more I yt-dlp+Aria2 全能容器,导航页+WebUI+Filebrowser网盘+联动Rclone自动上传功能以及更多☆21Jun 2, 2022Updated 4 years ago
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆80Aug 22, 2026Updated 2 months ago
- A lightweight web dashboard for viewing all your OpenClaw Bots/Agents/Models/Sessions status at a glance.☆13Jun 4, 2026Updated 5 months ago
- Single-card Intel Gaudi2 vLLM source snapshot: FP8 Qwen, non-greedy DFlash2/MTP, GDN kernels and host-side optimizations.☆19Updated this week
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 11 months ago
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆93Oct 26, 2026Updated 3 weeks ago
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Distillation pipeline from pretrained Transformers to customized FLA models☆13Aug 4, 2025Updated last year
- 破解弹琴吧网页播放VIP权限☆20Nov 13, 2021Updated 5 years ago
- forked from vllm-project/flash-attention☆75May 9, 2026Updated 6 months ago
- GA100 voltage glitch resources☆300Nov 11, 2026Updated last week
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆32Nov 3, 2026Updated 2 weeks ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆99Sep 28, 2026Updated last month
- Tries to UI development. Clone of https://www.perplexity.ai/☆11Sep 30, 2023Updated 3 years ago
Are these results useful?