DGX Spark / GB10 vLLM Docker stack for large-model serving, presets, patches, and validation notes.
☆12Jun 29, 2026Updated 3 months ago
Alternatives and similar repositories for spark_vllm_docker
Users that are interested in spark_vllm_docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Free, keyless web_search and web_fetch for the DeepSeek Harness (dsh) — DuckDuckGo-backed, no signup. Unofficial community project.☆18Sep 28, 2026Updated 3 weeks ago
- Give the DeepSeek Harness (dsh) eyes with any text model + any vision model: a vision proxy for chat image attachments and an analyze_ima…☆12Sep 28, 2026Updated 3 weeks ago
- Wrap commands that might cause out-of-memory errors, and stop them before they freeze your machine☆15Sep 22, 2026Updated last month
- Concurrency Patch to enable on DSpark - DeepSeek V4 Flash/Pro C=16 can be modified for more☆12Jun 29, 2026Updated 3 months ago
- Headless / multi-user serving-mode for the DGX Spark: free unified memory for vLLM by paring back the desktop. Companion to qwen3.5-122B-…☆20Jun 29, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- GLM-5.2 QuantTrio TP=4+DCP2 on 4x NVIDIA DGX Spark (GB10) — tuned and measured under a real agent workload. Adaptive MTP, the indexer law…☆19Aug 24, 2026Updated 2 months ago
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated last month
- GLM-5.3-Flash NVFP4 on 4x NVIDIA DGX Spark: vLLM TP4, DFlash2 adaptive draft, measured FP8 vs NVFP4 vs EXL3 vs SGLang☆39Sep 29, 2026Updated 3 weeks ago
- GLM-5.2 (744B/40B MoE) on a 4× DGX Spark / GB10 (sm_121) cluster: portable Triton sparse-MLA kernels, a data-free expert prune, MTP draft…☆37Aug 20, 2026Updated 2 months ago
- Recipe: GLM-5.2 (unpruned QuantTrio Int4-Int8Mix) at 200K ctx with MTP spec decode on a 4x NVIDIA DGX Spark (GB10) cluster☆76Jul 25, 2026Updated 3 months ago
- Run DeepSeek-V4-Flash at full 1M context AND two MiniMax H3 video instances on the same two DGX Sparks. Benchmarked C1-C6.☆35Aug 7, 2026Updated 2 months ago
- ☆17Sep 22, 2026Updated last month
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆30Updated this week
- DeepSeek V4 Flash @ 1M token context on 2x NVIDIA DGX Spark — production-tested recipe (45 tok/s decode, real 800K prompts served)☆37Jul 13, 2026Updated 3 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Working recipe to serve DeepSeek-V4-Flash across two NVIDIA DGX Spark (GB10) nodes with vLLM (TP=2, FP8 KV, MTP) over a RoCE/RDMA link — …☆85Jul 13, 2026Updated 3 months ago
- Run on TWO-DGX-Spark - vLLm-0.24.0 dual cache optimized DSV4F+DSpark+NVFP4 KV (Concurrency 12 with 1.5M context/3M KV token Pool) >0.58-0…☆21Aug 17, 2026Updated 2 months ago
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆12Aug 8, 2026Updated 2 months ago
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- GLM-5.2-Int4-Int8 on 8x GB10 cluster☆39Jul 30, 2026Updated 2 months ago
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆49Aug 23, 2026Updated 2 months ago
- DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)☆31Aug 3, 2026Updated 2 months ago
- qwen38-flash-next recipe for tp=2 GB10☆129Updated this week
- CloudlessOS☆14Aug 20, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- keys-DGX-Sparkticus Utimate Power Pack Unleashed (Dual DGX-Sparks Needed)☆43Aug 23, 2026Updated 2 months ago
- GLM-5.3-Flash NVFP4 (lab quant) on 2x DGX Spark — TP=2 over RoCE, one .env, compose head/worker, download/start/stop/status/tail-log☆11Sep 8, 2026Updated last month
- A community-owned map of LLM inference engine configurations — benchmarks, evals and coverage gaps, hosted on GitHub Pages. The repo is t…☆16Oct 19, 2026Updated last week
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆63Oct 18, 2026Updated last week
- Let's vibe hardware: create magical things by chatting with AI.☆48Jul 20, 2026Updated 3 months ago
- Honeycomb Lab — hex map + OpenAI gateway control plane for a home AI fleet☆17Updated this week
- Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, option…☆48Oct 13, 2026Updated last week
- agent multiplexer that lives in your terminal.☆14Updated this week
- Agent-ready two-node DGX Spark recipe for DeepSeek V4 Flash plus an optional Qwen Vision sidecar, with generic OpenAI-compatible, Hermes,…☆24Aug 10, 2026Updated 2 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Grafana dashboard for NVIDIA DGX Spark clusters running vLLM: throughput, contention, and GB10 GPU hardware telemetry (NVIDIA-themed, 55 …☆44Aug 18, 2026Updated 2 months ago
- Extensión de Burp Suite que incorpora detección pasiva de vulnerabilidades mediante inteligencia artificial.☆22Sep 4, 2026Updated last month
- 四足机器人控制板☆19Sep 26, 2022Updated 4 years ago
- ☆16Sep 25, 2026Updated last month
- The prompt studio for AI filmmaking — plan shots, direct coverage, keep continuity, and compile production-ready prompts for any image, v…☆70Aug 9, 2026Updated 2 months ago
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆20Oct 13, 2026Updated 2 weeks ago
- Three-DGX-Spark TP3 serving recipe for GLM-5.3 Flash☆19Oct 5, 2026Updated 3 weeks ago