NVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Qwen3.6-35B MoE.
☆27Apr 27, 2026Updated 5 months ago
Alternatives and similar repositories for blackwell-geforce-nvfp4-gemm
Users that are interested in blackwell-geforce-nvfp4-gemm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast LLM server for NVIDIA Blackwell: GeForce RTX 50 and RTX PRO. Qwen3.8-27B on one RTX 5090: 91-94 tok/s, 1.3x vLLM and 1.4x llama.cpp.…☆47Updated this week
- Answer-aware memory for Markdown notes: hybrid search + pluggable passage reranker, as a Claude Code plugin☆12Oct 15, 2026Updated last week
- ☆14Apr 24, 2026Updated 6 months ago
- A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official …☆545Updated this week
- A web-based memory usage and performance calculator for Huggingface GGUF models☆30Jul 20, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Hearthstone gives babysitters and family instant answers to household questions, grounded in your Google Docs with cited sources; Bun bac…☆23Jun 6, 2026Updated 4 months ago
- A Comprehensive Benchmark Framework for Retrieval-Augmented Generation (RAG) Routing and Query-Corpus Compatibility.☆13Feb 3, 2026Updated 8 months ago
- The code implementation of HyGRAG, accepted by WWW'26.☆17May 31, 2026Updated 4 months ago
- Index / recipe book for every GLM-5.3 (and GLM-5.2 foundation) serving recipe on NVIDIA DGX Spark (GB10): Flash + big 743B, TP2 + TP4, ev…☆13Aug 29, 2026Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆42Updated this week
- End-to-end formally verified solvers for the inviscid Burgers', isotropic viscous Burgers', and full (anisotropic) viscous Burgers' equat…☆16Sep 9, 2026Updated last month
- ☆18Sep 3, 2023Updated 3 years ago
- Routing-aware expert paging for memory-constrained MoE serving — a vLLM plug-in with byte-identical outputs and joint expert/KV memory al…☆15Sep 15, 2026Updated last month
- Open-source MCP server — progressive tool discovery, code execution, intelligent routing & token optimization across 50+ tools☆17Jun 25, 2026Updated 4 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Bigger local AI on the PC you already own. Find models, chat locally, and run supported sparse models across SSD, RAM and NVIDIA GPUs wit…☆21Updated this week
- dockerfiles, compose files, benchmarks for 2x R9700 serving☆28Oct 15, 2026Updated last week
- A CUDA-accelerated GGUF quantization tool for NVFP4/MXFP6/Q_K, utilizing layer by layer quantization and selection techniques to reduce e…☆49Aug 15, 2026Updated 2 months ago
- Open-source, web-based knowledge base — Obsidian-style linked markdown notes, backlinks and a GPU-rendered knowledge graph. FastAPI + Nex…☆30Updated this week
- Doc Thinker: All-in-One RAG - document parsing, graph RAG, and evaluation☆33Updated this week
- vLLM Qwen3.5-122B NVFP4 on DGX Spark (SM121) — full Docker build with 15 patches☆17Mar 17, 2026Updated 7 months ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 7 months ago
- Serving and fine-tuning for the Gemma 4 and Qwen3.6 model families on Modal (SGLang/vLLM) — solo and concurrent shapes, custom chat-templ…☆34Oct 3, 2026Updated 3 weeks ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆21Sep 26, 2026Updated 3 weeks ago
- A 3 MB iPXE boot ISO that installs 20+ server operating systems unattended — Ubuntu, Debian, AlmaLinux, Rocky, CentOS Stream, openSUSE. N…☆37Updated this week
- LLM-first Three.js WebGPU scene and animation authoring with a persistent native viewport and typed MCP editing☆24Sep 4, 2026Updated last month
- ☆26Oct 19, 2023Updated 3 years ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- A curated list of amazingly awesome BigBlueButton resources, integrations, and shiny things.☆13Dec 16, 2024Updated last year
- Fork of ligolo-ng with exec and service capability☆16Oct 30, 2023Updated 2 years ago
- ☆11Dec 8, 2023Updated 2 years ago
- Lightning-fast domain validator for security research. Multi-threaded scanning, smart verification, clean output for pipelines. Ideal for…☆14Dec 9, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Some resources to help you migrate PrestaShop to Symfony 3☆11Jan 20, 2020Updated 6 years ago
- OpenSCAD script to create custom 3D printable cable ducts.☆11Jun 15, 2025Updated last year
- Scalable URL obfuscator service☆11Feb 14, 2023Updated 3 years ago
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆107Updated this week
- Open-source SM120 (Blackwell) SASS assembler — encode, schedule & assemble GPU machine code, including all tensor-core instructions.☆12Updated this week
- Text embedding and re-ranking in Rust☆14Aug 5, 2026Updated 2 months ago
- Pruning and Distilling Mixture-of-Experts into Dense Language Models☆21Sep 2, 2026Updated last month