Known-good vLLM recipe: Qwen3.8-27B-Int8 + MTP speculative decoding on NVIDIA CMP 170HX 64GB (Hynix) — 84 tok/s, 262k ctx
☆13Oct 8, 2026Updated 3 weeks ago
Alternatives and similar repositories for cmp-170hx-vllm
Users that are interested in cmp-170hx-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 170hx-pve-gen2-controller☆11Aug 20, 2026Updated 2 months ago
- GPUDirect Storage (GDS) for the NVIDIA CMP 170HX on modern Linux kernels (6.18+). nvidia-fs NVMe registration hooks for the new blk_rq_dm…☆18Aug 19, 2026Updated 2 months ago
- An attempt to use Nvidia CMP cards for Machine Learning.☆33Jun 14, 2026Updated 4 months ago
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆96Oct 19, 2026Updated 2 weeks ago
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- glm-5.2 on too many 64 / 80 GB A100's☆22Sep 9, 2026Updated last month
- Run Faster-Qwen3-TTS on NVIDIA DGX Spark GB10 (ARM64/SM121/CUDA13) - OpenAI-compatible TTS API with CUDA graph acceleration☆30Oct 11, 2026Updated 3 weeks ago
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆27Aug 8, 2026Updated 2 months ago
- vLLM for NVIDIA CMP 170HX (Ampere sm_80): fast, repeatable model serving on one card or several☆27Updated this week
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆75Aug 22, 2026Updated 2 months ago
- ☆18Oct 1, 2025Updated last year
- A tool to unlobotomize your NVIDIA card!☆31Sep 6, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆19Updated this week
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- ☆24Jun 27, 2026Updated 4 months ago
- ☆18Sep 9, 2026Updated last month
- HIP kernels for AMD Strix Halo (gfx1151) and a vLLM plugin that runs them on stock upstream vLLM: up to 31x faster prefill and ~2x decode…☆21Updated this week
- Run local LLMs on a Tesla V100-SXM2-16GB: prebuilt binaries, serve scripts, and setup for Windows and Linux (Qwen3 + Gemma 4, Claude Code…☆20Sep 1, 2026Updated 2 months ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆96Sep 28, 2026Updated last month
- A planetary geared FDM filament extruder developed to work with the BLV Cube designed by Ben Levi. The design has two branches, one that…☆17Mar 7, 2021Updated 5 years ago
- ☆15Mar 15, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Reproducible Docker deployment for Qwen3.8-27B NVFP4 on NVIDIA DGX Spark (GB10, SM121) via OpenAI-compatible vLLM. Known-good baseline + …☆12Aug 14, 2026Updated 2 months ago
- ☆12Mar 16, 2026Updated 7 months ago
- Google Hotels MCP server and Python library — reverse-engineered batchexecute client with FastMCP tools☆14Aug 24, 2026Updated 2 months ago
- Chrome extension that displays your bookmarks on a new tab page☆14Aug 13, 2024Updated 2 years ago
- A paperless-ngx configuration to automatically translate documents to your desired languages.☆10Oct 9, 2026Updated 3 weeks ago
- Libegpu is a library for enumerating eGPU devices & enclosures.☆16Nov 24, 2025Updated 11 months ago
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆21Oct 6, 2026Updated last month
- Snapraid docker container☆10Jan 21, 2024Updated 2 years ago
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆21Oct 16, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- scripts to setup my home OpenShift test lab☆10Nov 9, 2018Updated 7 years ago
- Userspace driver for Samsung Gear VR Controller☆14Nov 9, 2019Updated 6 years ago
- Docker Compose for llama.cpp GGUF servers on AMD Strix Halo: Qwen, Gemma, and Laguna packages (abliterated and quantized), stock Vulkan p…☆28Aug 17, 2026Updated 2 months ago
- A Chrome Extension to make a Google Calendar event from a selection of text.☆11Mar 13, 2018Updated 8 years ago
- Local Anthropic API proxy that routes through Claude Code CLI — use your subscription, no API keys needed☆15Apr 24, 2026Updated 6 months ago
- Hassle-free multi-GPU upscaling with Topaz Video Enhance AI☆19Sep 8, 2022Updated 4 years ago
- Qwen3.8-Flash-Next (W4A16) on 2x CMP 170HX: 110 tok/s decode, 7K prefill, 800 tok/s @ 23 concurrent - runs on 38 GB home RAM, no pinned m…☆20Sep 18, 2026Updated last month