All-NVFP4 vLLM + DFlash2 K7 for Blackwell (SM120/SM121): NVFP4 target/draft/KV, 262K context, optional CPU vision sidecar.
☆41Aug 28, 2026Updated 2 months ago
Alternatives and similar repositories for vllm-sm12x-nvfp4-dflash2
Users that are interested in vllm-sm12x-nvfp4-dflash2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe and measured evidence for one NVIDIA DGX Spark☆21Sep 10, 2026Updated last month
- A native vLLM 0.26 DGX Spark recipe for Qwen3.6 35B-A3B NVFP4, focused on high aggregate throughput, 262K context, and production-friendl…☆15Aug 31, 2026Updated 2 months ago
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆64Oct 14, 2026Updated 3 weeks ago
- Custom llama.cpp fork for running EschaLabs Escha models.☆13Sep 11, 2026Updated last month
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Serve DeepSeek-V4-Flash-Vision EXL3 MixedK (full 256 experts) on one NVIDIA DGX Spark with vLLM — recipe, loader patches, and receipts☆14Sep 7, 2026Updated 2 months ago
- Qwen3.8 Flash-Next (NVFP4) on NVIDIA Flare for one DGX Spark / ASUS GX10: greedy, 8-agent speculative decoding, mixed prefill☆14Updated this week
- ☆15Sep 5, 2026Updated 2 months ago
- Serve the official Ling-3.0-flash INT4 on one NVIDIA DGX Spark, 38.7 tok/s, faster than the community GGUF. Recipe, watchdog, benchmarks.☆26Aug 29, 2026Updated 2 months ago
- Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-…☆137Sep 7, 2026Updated 2 months ago
- Pinned, checksum-verified GLM-5.3-Flash EXL3 K2 recipe for one NVIDIA GB10.☆45Updated this week
- Reproducible Qwen3.8-27B NVFP4 + DFlash2 recipe and qualification evidence for one NVIDIA DGX Spark☆30Aug 21, 2026Updated 2 months ago
- Qwen3.6/3.8-27B on one RTX 5090: 576K pooled context across 12 sessions at FP8-level quality from 5.75 bpw. EXL3 trellis weights, 4-bit t…☆29Oct 23, 2026Updated 2 weeks ago
- Validated vLLM recipe: Qwen3.8-27B-NVFP4 at full 262,144-token context on a single RTX 5090, GPU-only (no CPU offload).☆16Aug 20, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A local-first AI companion that keeps watching while nobody is talking, so it can tell you what you were doing five minutes ago. Runs ent…☆10Jul 29, 2026Updated 3 months ago
- A 2MB sklearn classifier on consumer CPU beats Cohere's $10M+ 218B MoE on HumanEval☆13Oct 18, 2026Updated 2 weeks ago
- A scope-grade oscilloscope app in Rust + Bevy for the OWON VDS1022☆14Sep 24, 2026Updated last month
- Reproducible kit to deploy DeepSeek-V4-Flash-DSpark on a 2× NVIDIA DGX Spark (GB10) cluster: vLLM TP=2 over QSFP 200GbE, NVFP4 KV, DSpark…☆13Aug 24, 2026Updated 2 months ago
- Qwen3.8-27B-NVFP4 on a Single RTX 5090 (vLLM)☆100Aug 16, 2026Updated 2 months ago
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆92Updated this week
- Qwen3.8-27B ADay777-Ablit · NVFP4 · A4Q · NVFP4-KV (4M+ pool) · MTP-3 — single DGX Spark (GB10/sm121), eugr vLLM 0.27. 1M ctx @ c=4.☆24Aug 17, 2026Updated 2 months ago
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆60Oct 20, 2026Updated 2 weeks ago
- Lightweight collapsible tree in 1.6k☆16May 27, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆16Sep 9, 2026Updated last month
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆74Updated this week
- Agent Zero AI framework☆13Sep 30, 2026Updated last month
- NATS cluster on Kubernetes with Java producer and Go subscriber☆10May 2, 2018Updated 8 years ago
- DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Sparks with TensorFold☆13Updated this week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆111Oct 25, 2026Updated 2 weeks ago
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆174Updated this week
- M3U generator optimized for Channels' custom channels.☆14Jan 12, 2022Updated 4 years ago
- Git-aware team memory for Claude Code☆10Jul 3, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Real-time audio enhancement for HTML5 video and audio directly in your browser.☆12Sep 30, 2026Updated last month
- Lightweight embedded JSON mapper for C — structured data-to-JSON mapping with declarative macros. ThreadX/FreeRTOS/baremetal ready.☆13Jun 15, 2026Updated 4 months ago
- A small, secure HTTP egress gateway with per-domain rate limiting, circuit breaking, queueing, caching, and SSRF protection.☆16Sep 9, 2026Updated last month
- Fun playground and adventure game☆13Updated this week
- qwen38-flash-next recipe for tp=2 GB10☆133Oct 29, 2026Updated last week
- An OpenCode plugin that lets AI agents control Windows desktops directly using the \windows-mcp\ MCP server.☆18Jul 10, 2026Updated 3 months ago
- ☆10May 1, 2024Updated 2 years ago