Complete guide to running Qwen3.5-35B-A3B on NVIDIA DGX Spark (GB10) with vLLM - installation, benchmarks, vision features, and troubleshooting
☆96Mar 11, 2026Updated 4 months ago
Alternatives and similar repositories for qwen3.5-dgx-spark
Users that are interested in qwen3.5-dgx-spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM + Qwen3.5-122B-A10B-NVFP4 on NVIDIA DGX Spark (GB10/SM121) — single-GPU NVFP4 W4A4 with MTP speculative decoding, self-contained Doc…☆40Mar 12, 2026Updated 4 months ago
- Serve the home! Inference stack for your Nvidia DGX Spark aka the Grace Blackwell AI supercomputer on your desk. Mostly vLLM based for no…☆50Updated this week
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆15May 11, 2026Updated 2 months ago
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆124Feb 22, 2026Updated 5 months ago
- Docker configuration for running VLLM on dual DGX Sparks☆1,886Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- One-command vLLM installation for NVIDIA DGX Spark with Blackwell GB10 GPUs (sm_121 architecture)☆104Oct 28, 2025Updated 8 months ago
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆92Jul 11, 2026Updated last week
- Run Qwen3.5-35B-A3B with llama.cpp and openclaw on NVIDIA DGX Spark (GB10)☆72Mar 1, 2026Updated 4 months ago
- DGX Spark research and tests - containers, benchmarks, and investigation notes for running models on GB10 (SM 12.1)☆19Updated this week
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems☆406Updated this week
- DeepSeek V4 Flash DSpark 1M NVFP4 KV recipe for 2x DGX Spark☆155Jul 16, 2026Updated last week
- AEON vLLM Ultimate — vLLM 0.25.0 built from source for DGX Spark / Blackwell (sm_121a/GB10). One image serves the whole AEON fleet (Gemma…☆98Jul 17, 2026Updated last week
- Fully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.i…☆424Jul 3, 2026Updated 3 weeks ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆16Mar 23, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Collection of step-by-step playbooks for setting up AI/ML workloads on NVIDIA DGX Spark devices with Blackwell architecture.☆1,172Updated this week
- Run vLLM on 1-to-N NVIDIA DGX Spark servers (single Spark, 2 via direct cable, or 3+ via switched fabric) to serve or benchmark LLMs☆122Jun 22, 2026Updated last month
- Single-file web UI for NVIDIA DGX Spark — pull Ollama models, browse and download from HuggingFace, manage LiteLLM routing, and control S…☆28May 19, 2026Updated 2 months ago
- Qwen3.5-122B-A10B on DGX Spark: 28.3 → 51 tok/s (+80%)☆283Jun 2, 2026Updated last month
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆84Jul 9, 2026Updated 2 weeks ago
- comfyui optimizations for the dgx spark☆28Apr 30, 2026Updated 2 months ago
- A MCP client that enables Mistral AI models to autonomously execute complex tasks across web and local environments through standardized …☆18Apr 1, 2025Updated last year
- Official Spark Arena Recipe Registry☆52Jun 13, 2026Updated last month
- This repository contains examples of insecure code and/or security misconfigurations in common Agent frameworks☆16Apr 4, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Sglang LLM Inference: RTX Pro 6000 vs DGX Spark☆19Oct 18, 2025Updated 9 months ago
- Pure Rust Inference Engine☆609Updated this week
- Mixed-capability LLM benchmark for DGX Spark — 57 scenarios, 10 domains, partial-credit grading, trial statistics☆136Jul 11, 2026Updated 2 weeks ago
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆45Jun 29, 2026Updated 3 weeks ago
- DeepSeek V4 Flash specific inference engine. SSD MoE expert paging (slot-bank) + disk KV cache for long agent sessions. Metal-first, narr…☆29Jul 18, 2026Updated last week
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆17Updated this week
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆84Updated this week
- Deploy concurrent Hermes Agent workers on unified-memory GPUs (GB10, DGX Spark) for maximum total tok/s. Profile-isolated, kanban-coordin…☆72Updated this week
- A collection of templates/widgets for rapid prototyping☆12Jul 6, 2011Updated 15 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 200K ctx with MTP spec decode on a 4x NVIDIA DGX Spark (GB10) cluster☆69Updated this week
- Python library to infer date format from examples☆45Nov 16, 2021Updated 4 years ago
- ☆166Updated this week
- iOS app that syncs device's photos to an FTP NAS server☆10Nov 4, 2017Updated 8 years ago
- Learn about Probabilistic Time Series Forecasting, its key techniques, real-world applications, and advantages over traditional forecasti…☆47Mar 10, 2025Updated last year
- Object-storage-native KV cache for LLM inference & RL. Cross-restart, cross-conversation, cross-engine via shared S3 bucket.☆19Updated this week
- Feature flags for python.☆18May 22, 2017Updated 9 years ago