NVFP4 KV cache for vLLM on SM120 (RTX PRO 6000) via FlashInfer FA2 explicit-SF-stride patch — ~1.5x fp8 pool at ~95-104% speed
☆20Jun 5, 2026Updated 5 months ago
Alternatives and similar repositories for vllm-nvfp4-kv-sm120
Users that are interested in vllm-nvfp4-kv-sm120 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆37Apr 26, 2026Updated 6 months ago
- Experimental Normalized Attention Guidance node for Anima in ComfyUI.☆14Oct 18, 2026Updated 3 weeks ago
- Hikari's curated English measured notes on local LLM systems (serving, specdec, training, steering).☆15Jul 29, 2026Updated 3 months ago
- Qwen3.8-27B NVFP4 (W4A16 shipped recipe) + MTP on NVIDIA DGX Spark GB10/SM121 — vLLM v0.27.2rc0, FP8 KV, 262K context, full reproducibili…☆27Aug 20, 2026Updated 2 months ago
- Sample code to demonstrate how to implement a simple chat that works on .NET MAUI, Blazor and Blazor Hybrid with SignalR☆10Feb 14, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Truthful scheduler-step and streaming visualization for local LLM inference☆36Sep 6, 2026Updated 2 months ago
- Validated GLM-5.3 Flash recipe for 2x NVIDIA RTX PRO 6000 Blackwell 96GB: 262K context, EXL3/TR3, adaptive MTP, tools, and vision.☆63Sep 20, 2026Updated last month
- Do multiple agents sharing a single asymmetrically-compressed KV pool produce quality output comparable to full-precision per-agent KV ca…☆13Apr 26, 2026Updated 6 months ago
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆129Nov 4, 2026Updated last week
- Autoformalization of Baek's solution to the moving sofa problem: the Gerver sofa is optimal☆13Sep 22, 2026Updated last month
- Lean formalization of the smooth and topological Poincare conjectures following Morgan and Tian.☆15Oct 5, 2026Updated last month
- Docker config for vLLM GLM-4.7-Flash support with glm4_moe_lite patch☆12Jan 21, 2026Updated 9 months ago
- PR project☆11May 20, 2025Updated last year
- ☆11Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12Aug 19, 2026Updated 2 months ago
- Qwen3.8-27B QSA for llama.cpp with MTP, native multimodal attention, and prefix-cache reuse☆15Nov 5, 2026Updated last week
- A Lean Formalization Benchmark for Advanced Mathematics☆15Nov 2, 2026Updated last week
- Prompt Engineering'i öğrenebileceğiniz Erdoğan Eker ile birlikte oluşturduğumuz bir kitap.☆12Sep 9, 2024Updated 2 years ago
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- repo behind the site☆10Sep 29, 2015Updated 11 years ago
- PlayList Animation using MAUI.☆14Nov 1, 2022Updated 4 years ago
- ☆23Oct 18, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆65Nov 4, 2026Updated last week
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 2 weeks ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated 2 weeks ago
- Public documentation, privacy policy, and support pages for StackChan Pet Talk.☆13Aug 8, 2026Updated 3 months ago
- keys- 1M context: Inkling-Small-NVFP4 + DSpark + NVFP4 KV on SGLang, sm_121a-optimized on Two DGX Sparks — one-shot agent-executable rec…☆10Aug 17, 2026Updated 2 months ago
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 3 months ago
- ComfyUI nodes for Mistral's Voxtral-4B text-to-speech model with direct PyTorch inference. Supports 20 preset voices across 9 languages o…☆13Aug 23, 2026Updated 2 months ago
- MiniMax-M3 (428B, no pruning) at 36 tok/s on 2× NVIDIA DGX Spark — W4A16 GPTQ + NVFP4 KV + EAGLE-3 speculative decoding on vLLM. Three se…☆45Jul 13, 2026Updated 4 months ago
- DSpark-style speculative decoding draft head for Qwen3.6-27B AEON: training recipe, paired eval harness, vLLM patches. +11% serve tok/s v…☆14Jul 2, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆21Updated this week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆112Oct 25, 2026Updated 2 weeks ago
- Tools for writing good AI generated papers☆17Oct 24, 2026Updated 2 weeks ago
- ComfyUI workflows for running MiniMax-H3 T2V and I2V on an RTX 3060 12GB☆32Aug 27, 2026Updated 2 months ago
- Security capability evaluation of locally served models. Method, corpus, and per-model results.☆20Oct 19, 2026Updated 3 weeks ago
- NVIDIA Fan Control Service tested on Ubuntu providing more aggressive fan curves for RTX Pro 6000 GPUs☆20Jan 17, 2026Updated 9 months ago
- ☆14Jan 22, 2026Updated 9 months ago
Are these results useful?