glm-5.2 on too many 64 / 80 GB A100's
☆22Sep 9, 2026Updated last month
Alternatives and similar repositories for vllm-170hx-glm5
Users that are interested in vllm-170hx-glm5 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tool to unlobotomize your NVIDIA card!☆32Sep 6, 2026Updated last month
- A cmpunlocker fork with working p2p on SYS-4028GR-TRT2☆26Aug 8, 2026Updated 2 months ago
- Unlock tool for the NVIDIA CMP 170HX (GA100) mining card. Restores full A100 compute throughput by exploiting the Falcon BootROM .fwsigna…☆57Jul 30, 2026Updated 2 months ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆90Sep 28, 2026Updated 3 weeks ago
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- GLM-5.3-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 482.6 tok/s single-user, up to 943.7 tok/s at 8 users, 262K context, TP4 or PP4, on…☆83Updated this week
- NInfer SM80 port for NVIDIA CMP 170HX☆28Aug 22, 2026Updated 2 months ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆88Updated this week
- CMP 170HX technical wiki: silicon, firmware, the community unlock, procedures and open problems. 55 pages.☆73Aug 22, 2026Updated 2 months ago
- Dogfooding vLLM backport for older GPUs.☆333Updated this week
- The most comprehensive community resource for the NVIDIA CMP 170HX.☆128Jul 30, 2026Updated 2 months ago
- Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and in…☆18Nov 11, 2024Updated last year
- ☆33Jul 25, 2026Updated 2 months ago
- ☆64Aug 6, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A tool to unlobotomize your NVIDIA card!☆782Oct 8, 2026Updated 2 weeks ago
- Makerbase DRG FT2232 FT2232HL Development Board FT2232H USB Port Support JTAG openOCD☆10Jan 7, 2023Updated 3 years ago
- Linux P2P unlock and performance fixes for NVIDIA CMP 170HX☆39Sep 22, 2026Updated last month
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆58Updated this week
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated last month
- The complete NUMA-optimized branch of the ktransformers project☆26Nov 3, 2025Updated 11 months ago
- NVIDIA Linux open GPU with P2P support☆12Aug 2, 2026Updated 2 months ago
- H-LINK bus sniffer for an HITACHI YUTAKI S80 COMBI Heat pump. Works on a Raspberry Pi Zero 2W using Python.☆18Feb 7, 2022Updated 4 years ago
- ROCm for gfx803 aka RX 460, RX 470, RX 480, RX 550, RX 560, RX 570, RX 580 and RX 590 with custom patches, kernel fixes, etc☆41Oct 6, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆50Aug 28, 2026Updated last month
- Mail-in-a-Docker (MIAD) helps you run Mail-in-a-Box (MIAB) in a docker container, making it easy to run other services on your box that w…☆14Jul 2, 2024Updated 2 years ago
- 🚿 Llaminar: an LLM inferencing engine in C++.☆45Oct 9, 2026Updated last week
- Program to drive the Nvidia 3D Vision Shutter glasses without the Nvidia 3D Vision driver.☆16Apr 20, 2024Updated 2 years ago
- Modified AWG based on the Raspberry Pico with slight modifications to an already exisiting project☆20Aug 25, 2023Updated 3 years ago
- Script to install and configure PotPlayer with MVC (Blu-ray 3D) decoding, 3D Vision and optionally SVP motion interpolation and madVR ups…☆22May 7, 2025Updated last year
- Backup of last-known WizIO-Pico platform written by @WizIO☆19Apr 1, 2023Updated 3 years ago
- Agentic test batteries for local models via Hermes Agent - scripted tools + real Hermes CLI sessions☆15Aug 14, 2026Updated 2 months ago
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆60Sep 16, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ESP32-C3 Development Board☆21May 13, 2026Updated 5 months ago
- Some tools and exploits for the NVIDIA Falcon v5 TSEC engines☆38Jan 2, 2022Updated 4 years ago
- NeoGrip allows you to use VR headsets purchased without original controllers or create your own custom VR controllers.☆21Jul 27, 2026Updated 2 months ago
- Agnost GitOps Helm charts☆13Dec 9, 2025Updated 10 months ago
- moonlight-android fork that has optional support of Leia Lume Pad 2☆22Jun 7, 2024Updated 2 years ago
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆20Oct 6, 2026Updated 2 weeks ago
- Out-of-tree Linux driver stack and boot tooling for the Cavium CN6640-SNIC10E (Octeon II, PCI 177d:0092), exposing the card as two indepe…☆52Oct 10, 2026Updated last week