vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several
☆28Nov 2, 2026Updated last week
Alternatives and similar repositories for vllm-cmp170hx
Users that are interested in vllm-cmp170hx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command c…☆31Nov 2, 2026Updated last week
- ☆30Oct 20, 2026Updated 3 weeks ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆99Updated this week
- some experiments about 170hx 10g version.☆11Oct 19, 2026Updated 3 weeks ago
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆119Aug 13, 2026Updated 3 months ago
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆90Oct 26, 2026Updated 2 weeks ago
- Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx☆13Oct 8, 2026Updated last month
- dsv41-flash-pp5-170hx &pp6 Supports the original (full/unquantized) model. Prefill 7,000 t/s, decode 45-75-125 t/s. dspark. Requires 200 …☆13Updated this week
- 170hx-pve-gen2-controller☆11Aug 20, 2026Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆38Nov 4, 2026Updated last week
- 1Cat-vLLM on Intel Gaudi☆48Oct 12, 2026Updated last month
- A tool to unlobotomize your NVIDIA card!☆841Oct 28, 2026Updated 2 weeks ago
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The most comprehensive community resource for the NVIDIA CMP 170HX.☆137Jul 30, 2026Updated 3 months ago
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆78Aug 22, 2026Updated 2 months ago
- ☆14Oct 20, 2026Updated 3 weeks ago
- GPU peer-to-peer over dynamic BAR1 for GeForce cards: patched NVIDIA open kernel modules.☆22Nov 6, 2026Updated last week
- Cross-tier CPU/GPU hybrid MoE inference for SGLang (plugin, tracks upstream main)☆77Updated this week
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 3 months ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated last year
- 限制问题区域显存 62906MiB / 65024MiB 支持驱动 610.57.04 ，修改显卡显示名称为NVIDIA Tesla A100☆12Aug 30, 2026Updated 2 months ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Wireless magnetic card emulation☆15Sep 21, 2019Updated 7 years ago
- Single-card Intel Gaudi2 vLLM source snapshot: FP8 Qwen, non-greedy DFlash2/MTP, GDN kernels and host-side optimizations.☆18Updated this week
- A planetary geared FDM filament extruder developed to work with the BLV Cube designed by Ben Levi. The design has two branches, one that…☆17Mar 7, 2021Updated 5 years ago
- Reproducible Docker deployment for Qwen3.8-27B NVFP4 on NVIDIA DGX Spark (GB10, SM121) via OpenAI-compatible vLLM. Known-good baseline + …☆12Aug 14, 2026Updated 2 months ago
- ☆15Mar 15, 2026Updated 7 months ago
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month
- Recreated gerbers for the Supermicro X11SSH-F motherboard.☆19Aug 2, 2023Updated 3 years ago
- Open-source gravitational energy storage system. Converts potential energy into usable electricity using a chain-driven transmission, mag…☆11May 15, 2026Updated 5 months ago
- Paste a story, get a film. A ComfyUI node pack that plans a story into shots, casts it with Krea2 reference sheets, and renders it with M…☆20Aug 29, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆10Nov 19, 2024Updated last year
- NInfer SM80 port for NVIDIA CMP 170HX☆29Aug 22, 2026Updated 2 months ago
- Rebecca base16☆10Dec 27, 2016Updated 9 years ago
- A Rust library for draping polygons over terrain with gfx☆11Mar 5, 2018Updated 8 years ago
- A modular and lightweight library for Forward And Backward Iterative Kinematics (FABRIK) on Arduino and ESP32.☆13May 9, 2026Updated 6 months ago
- Self-hosted fleet management dashboard for AI and compute machines. Monitor GPU health, control services, open terminals — one dark-mode …☆17Updated this week
- Bash script presents crontab in human readable form.☆11Apr 21, 2018Updated 8 years ago
Are these results useful?