☆696Oct 29, 2026Updated this week
Alternatives and similar repositories for spark-local-inference
Users that are interested in spark-local-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆43Updated this week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆109Updated this week
- LLM Inference Engine for Metal, CUDA and Vulkan.☆1,532Updated this week
- sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard☆774Updated this week
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆745Oct 18, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- qwen38-flash-next recipe for solo GB10☆165Updated this week
- qwen38-flash-next recipe for tp=2 GB10☆130Updated this week
- Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slat…☆216Updated this week
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆164Oct 22, 2026Updated last week
- Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)☆621Oct 4, 2026Updated 3 weeks ago
- Run the AEON Bench suite on your own hardware: verified HuggingFace pull → serve → benchmark (text · agentic ×3 harnesses · vision · audi…☆25Oct 6, 2026Updated 3 weeks ago
- Qwen3.8-Flash-Next-NVFP4-vLLM-Dual-DGX-Spark☆411Sep 29, 2026Updated last month
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆268Oct 6, 2026Updated 3 weeks ago
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,497Oct 4, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Qwen3.8 Flash Next on one DGX Spark (TensorFold)☆339Updated this week
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆101Oct 19, 2026Updated last week
- Mixed-capability LLM benchmark for DGX Spark — 57 scenarios, 10 domains, partial-credit grading, trial statistics☆172Oct 13, 2026Updated 2 weeks ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆63Oct 18, 2026Updated last week
- Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-…☆131Sep 7, 2026Updated last month
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆38Sep 25, 2026Updated last month
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆93Oct 22, 2026Updated last week
- GLM-5.3-Flash (Z.ai) NVFP4 (LibertAI) + NVFP4 KV, 1M context on 2x DGX Spark GB10 — vLLM TP2 recipe, walls ledger, benchmarks, needle to …☆29Aug 31, 2026Updated last month
- DeepSeek-V4.1-Flash-1017 on NVIDIA DGX Sparks with TensorFold + EXL3: TP4 (4 Sparks, 93.6 tok/s, 1M context) and TP2 (2 Sparks, 73 tok/s)…☆154Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built wi…☆144Updated this week
- Optimized inference for the DGX Spark and spark clusters☆130Updated this week
- Reproducible Qwen3.8-27B NVFP4 + DFlash2 recipe and qualification evidence for one NVIDIA DGX Spark☆30Aug 21, 2026Updated 2 months ago
- Qwen3.8 27B on SGLang for DGX Spark☆479Sep 12, 2026Updated last month
- GLM-5.3-Flash (abliterated EXL3) on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8x faster decode than vLLM, 4x256k concurrent threa…☆117Oct 20, 2026Updated last week
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆76Sep 4, 2026Updated last month
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆404Updated this week
- Serve the official Ling-3.0-flash INT4 on one NVIDIA DGX Spark, 38.7 tok/s, faster than the community GGUF. Recipe, watchdog, benchmarks.☆26Aug 29, 2026Updated 2 months ago
- GLM-5.3-Flash (NVFP4) on 2x NVIDIA DGX Spark - vLLM TP2, 262K context, MTP. World-first deploy recipe: 7 day-0 bugs found and fixed, patc…☆241Sep 30, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks☆279Sep 19, 2026Updated last month
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆40Oct 22, 2026Updated last week
- MiMo-V2.5 Omni TP=2 on 2x DGX Spark · 1M context · NVFP4 4-bit KV (~1.97M-token KV pool @ 1M, ~30 tok/s) · 69-eval: thinking-OFF 97.8 bea…☆39Jul 13, 2026Updated 3 months ago
- DeepSeek-V4.1-Flash on 3-4x NVIDIA DGX Sparks☆279Oct 17, 2026Updated last week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆71Updated this week
- DeepSeek-V4.1-Flash-1017 EXL3 on 2x DGX Sparks with TensorFold☆337Updated this week
- Run Qwen3.8-Flash-Next (180B) on a single DGX Spark by keeping its 51B n-gram embedding table on NVMe☆125Aug 30, 2026Updated last month