Docker compose serving stack for DeepSeek v4 Flash DSpark for NVIDIA Spark GB10 system using Aidendle94 image
☆33Aug 30, 2026Updated 2 months ago
Alternatives and similar repositories for DeepSeek-v4-DSpark-Aidendle94-GB10-ServingStack
Users that are interested in DeepSeek-v4-DSpark-Aidendle94-GB10-ServingStack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated 2 months ago
- GLM-5.3-Flash (EXL3 4bpw + DFlash2) on 2x NVIDIA DGX Spark: one-shot installer, 33-74 tok/s c1, 1.3M+ context, vision☆43Sep 2, 2026Updated 2 months ago
- ☆17Sep 6, 2026Updated 2 months ago
- DeepSeek V4 Flash DSpark 1M NVFP4 KV recipe for 2x DGX Spark☆499Sep 10, 2026Updated 2 months ago
- Headless / multi-user serving-mode for the DGX Spark: free unified memory for vLLM by paring back the desktop. Companion to qwen3.5-122B-…☆21Jun 29, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- DGX Spark / GB10 vLLM Docker stack for large-model serving, presets, patches, and validation notes.☆12Jun 29, 2026Updated 4 months ago
- DeepSeek V4.1 Flash 1017 on dual DGX Spark: TensorFold and vLLM recipes, matching Engrams, and C1–C8 thinking off/75 prefill and decode m…☆13Oct 18, 2026Updated last month
- A dashboard for a home cluster of NVIDIA GB10 (DGX Spark / ASUS GX10) inference servers: GPU and system health, plus live per-model metri…☆16Updated this week
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆108Aug 20, 2026Updated 2 months ago
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,519Oct 4, 2026Updated last month
- ☆18May 31, 2026Updated 5 months ago
- BertholomusAI recipe: DeepSeek-V4.1-Flash-1017 on 2x NVIDIA DGX Spark (GB10), our own TensorFold TP2 engine. Weights: bertholomus EXL3 2.…☆73Nov 4, 2026Updated 2 weeks ago
- DeepSeek-V4.1-Flash-1017 EXL3 2.9bpw on 2x NVIDIA DGX Spark (GB10) with TensorFold: 2.1-2.3x the vLLM kit's decode speed.☆84Updated this week
- ☆17Jan 15, 2026Updated 10 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8-1.9x code, 2.5x multi-stream, 1.7-1.95x prefill vs the vLLM ki…☆147Updated this week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆76Updated this week
- Official Spark Arena Recipe Registry☆67Oct 17, 2026Updated last month
- Give text-only LLMs vision. A tiny OpenAI-compatible proxy that lets reasoning models (DeepSeek, Qwen, GLM…) see images by querying a sep…☆49Jul 7, 2026Updated 4 months ago
- Archived fork of antirez/ds4 for GB10 DSpark — continues as Athena: github.com/xangel82/Athena-Engine☆28Oct 30, 2026Updated 2 weeks ago
- Qwen3.5-122B-A10B on DGX Spark: 28.3 → 51 tok/s (+80%)☆318Aug 23, 2026Updated 2 months ago
- Local model hosting with 2x DGX Sparks☆12Aug 29, 2026Updated 2 months ago
- GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threa…☆126Oct 30, 2026Updated 2 weeks ago
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆78Oct 26, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆128Feb 22, 2026Updated 8 months ago
- Real-time terminal UI dashboard for monitoring vLLM☆36Jul 13, 2026Updated 4 months ago
- A monitor of resources for DGX Spark☆26Feb 13, 2026Updated 9 months ago
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆166Oct 26, 2026Updated 3 weeks ago
- Per-session analytics for Hermes Desktop: tokens, cache, cost, failures, files — plus Ask AI analysis☆16Sep 27, 2026Updated last month
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆59Jun 29, 2026Updated 4 months ago
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 5 months ago
- GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft…☆37Aug 20, 2026Updated 2 months ago
- Validate the usable size of your local LLM cache under pressure☆12Sep 26, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- LLM proxy specialized in analyzing harness traffic to catch cache invalidation.☆58Sep 27, 2026Updated last month
- DGX Spark inference dashboard — vLLM, SGLang, llama.cpp, WebGPU & sparkrun with agent-powered Auto-Fix and speed optimization☆71Oct 26, 2026Updated 3 weeks ago
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRg…☆565Updated this week
- GLM-5.3-Flash EXL3 on 2x DGX Spark with TensorFold☆535Nov 4, 2026Updated 2 weeks ago
- Prebuilt ONNX Runtime 1.24.4 with CUDA EP for aarch64 Linux + NVIDIA Blackwell (sm_121)☆12Apr 10, 2026Updated 7 months ago
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆762Nov 4, 2026Updated 2 weeks ago
- Docker configuration for running VLLM on dual DGX Sparks☆2,503Updated this week
Are these results useful?