☆75Feb 27, 2026Updated 8 months ago
Alternatives and similar repositories for spark-vllm-mxfp4-docker
Users that are interested in spark-vllm-mxfp4-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Apr 7, 2026Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆13Apr 14, 2026Updated 6 months ago
- A model loader that uses fastsafetensors library to perform a fast, zero-copy load from storage to VRAM.☆23Jan 21, 2026Updated 9 months ago
- Docker configuration for running VLLM on dual DGX Sparks☆2,477Updated this week
- Linux hwmon driver for the NVIDIA DGX Spark (GB10 SoC) that exposes full system power telemetry via standard sensors / sysfs interfaces.☆40Mar 2, 2026Updated 8 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Qwen3.6 27B × DFlash — 30-35 tok/s on NVIDIA DGX Spark (GB10) - LLama.Cpp☆17May 2, 2026Updated 6 months ago
- FlashQLA TileLang GDN kernels ported to NVIDIA Blackwell consumer (GB10 / DGX Spark)☆18Jun 5, 2026Updated 5 months ago
- ☆12Feb 24, 2026Updated 8 months ago
- ☆18May 31, 2026Updated 5 months ago
- ☆16Jun 27, 2026Updated 4 months ago
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 5 months ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 7 months ago
- Qwen 3.8 Flash NVFP4 with PLE NVFP4 quantized to run on a single DGX Spark☆15Aug 28, 2026Updated 2 months ago
- Docker compose configs for serving Qwen3.8-27B on a DGX Spark (GB10): vLLM+MTP current, SGLang+DSPARK + FP8 rollback stacks☆13Oct 27, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆105Updated this week
- MiniMax M2 inference server for NVIDIA DGX Spark☆17Jan 24, 2026Updated 9 months ago
- ☆10Dec 12, 2025Updated 10 months ago
- Test to see if a DGX Spark (or similar GB10 device) is throttling due to possible Power Delivery issues☆33Sep 28, 2026Updated last month
- Qwen3.5-122B-A10B on DGX Spark: 28.3 → 51 tok/s (+80%)☆316Aug 23, 2026Updated 2 months ago
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆128Feb 22, 2026Updated 8 months ago
- Optimized SGLang MoE kernel configs for NVIDIA DGX Spark (GB10) - GLM-4.7-FP8 and other MoE models☆13Feb 7, 2026Updated 9 months ago
- Automated install script for Steam & FEX on Ubuntu 24.04☆12Aug 28, 2026Updated 2 months ago
- An Enhanced TOP program to monitor your Nvidia DGX SPARK's Hardware☆38Jan 6, 2026Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simple dashboard for the DGX Spark.☆43Aug 8, 2026Updated 2 months ago
- A script to launch Qwen3.8-Flash-Next in a single DGX-Spark (or its variants) at 40+ tok/s inference speed.☆34Aug 31, 2026Updated 2 months ago
- comfyui optimizations for the dgx spark☆37Apr 30, 2026Updated 6 months ago
- BertholomusAI recipe: DeepSeek-V4.1-Flash-1017 on 2x NVIDIA DGX Spark (GB10), our own TensorFold TP2 engine. Weights: bertholomus EXL3 2.…☆64Updated this week
- ☆13Apr 27, 2025Updated last year
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRg…☆561Updated this week
- LLM Stack for nVidia DGX Spark containing LiteLLM, LamaSwap, vLLM, Llama.cpp and ollama☆47Updated this week
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆59Jun 29, 2026Updated 4 months ago
- recipe for running Qwen3.8-Flash-Next on a single DGX Spark☆508Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Terminal system monitor (TUI) that builds its layout from the hardware it actually finds — hybrid CPU clusters, GPUs, RDMA/RoCE NICs, PCI…☆17Updated this week
- Repo for talk "Learnings of Building Legal Agents" at AI Engineering Stockholm 23/4 2025☆10Apr 23, 2025Updated last year
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆270Oct 6, 2026Updated last month
- Some benchmark results of small models and quants that fit on DGX Spark☆51Aug 23, 2026Updated 2 months ago
- One-command vLLM installation for NVIDIA DGX Spark with Blackwell GB10 GPUs (sm_121 architecture)☆110Oct 28, 2025Updated last year
- ☆21Aug 31, 2026Updated 2 months ago
- Official Spark Arena Recipe Registry☆66Oct 17, 2026Updated 3 weeks ago