☆541Oct 21, 2026Updated this week
Alternatives and similar repositories for flare-local-inference
Users that are interested in flare-local-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆107Oct 15, 2026Updated last week
- Universal AI computer-control KVM (REST API + MCP) that drives any machine as plain USB hardware — nothing installed on the target. Built…☆20Oct 6, 2026Updated 2 weeks ago
- Local image generation and editing for NVIDIA DGX Spark, powered by Qwen-Image-2.1 and Gradio.☆31Sep 21, 2026Updated last month
- Switchless RoCE collectives, NCCL profiles and fabric tooling for DGX Spark inference recipes☆37Updated this week
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆36Sep 25, 2026Updated 3 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Dist-MoE implements Speed-of-Light distributed Mixture-of-Experts forward and backward kernels. They are highly optimized and fused comm-…☆17Updated this week
- Fast, capable GLM-5.3-Flash FP4-Local on two DGX Sparks: opinionated Atlas serving and reproducible inference research.☆67Updated this week
- Terminal braille rendering library for images, animation, and expressive CLI graphics.☆12Oct 7, 2026Updated 2 weeks ago
- MiMo-V2.5 Omni TP=2 on 2x DGX Spark · 1M context · NVFP4 4-bit KV (~1.97M-token KV pool @ 1M, ~30 tok/s) · 69-eval: thinking-OFF 97.8 bea…☆39Jul 13, 2026Updated 3 months ago
- Accelerando-8192 — an 8,192-token alien glyph alphabet, interactive encoder, and complete visual atlas.☆58Oct 11, 2026Updated last week
- sparkDash ⚡ — Multi-DGX Spark Monitoring Dashboard☆749Updated this week
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆97Updated this week
- English guide + one-command patcher for the vLLM spin-wait bug that overheats NVIDIA DGX Spark / GB10. Credit: nacyot. CPU cores spin at …☆24Aug 17, 2026Updated 2 months ago
- GLM-5.3-Flash EXL3 (320B MoE) on 2x NVIDIA DGX Spark — production serving kit, 1M context, 97%+ multi-session prefix caching, DFlash2 spe…☆62Oct 5, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slat…☆177Updated this week
- LLM Inference Engine for Metal and CUDA.☆1,387Updated this week
- qwen38-flash-next recipe for solo GB10☆157Updated this week
- DeepSeek-v4-Flash 0731 recipe for 2x DGX Sparks☆1,482Oct 4, 2026Updated 2 weeks ago
- Run Qwen3.8-Flash-Next (180B) on a single DGX Spark by keeping its 51B n-gram embedding table on NVMe☆125Aug 30, 2026Updated last month
- Qwen3.8-Flash-Next (NVFP4) on DGX Spark in vLLM: one Spark 43.9 tok/s with our disk-backed n-gram table patch, staged gather and reduced-…☆129Sep 7, 2026Updated last month
- We gave AI models telepathy.☆21Sep 25, 2026Updated 3 weeks ago
- Pinned, checksum-verified GLM-5.3-Flash EXL3 K2 recipe for one NVIDIA GB10.☆37Oct 14, 2026Updated last week
- Fan Shroud for the Spark platform, for improved cooling performance on long workloads. Full STL/STEP files + electronics schematics☆39Sep 22, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Qwen3.8 27B on SGLang for DGX Spark☆473Sep 12, 2026Updated last month
- Full GLM-5.3 (753B, Int4-Int8Mix) on 4x NVIDIA DGX Spark, vLLM TP4☆23Oct 13, 2026Updated last week
- Official Inference Code of EAGLE-4☆836Updated this week
- Experience-Driven Black-Box Cost Control for Coding Agents☆145Updated this week
- GLM-5.3 Flash EXL3 for 2-4x DGX Sparks☆738Updated this week
- Autonomous self-improving 4x DGX Spark (GB10) MoA stack + LoRA loop (DSV4F router, Qwen3.6/Omni/TwoTower/Gemma). Hermes MoA routing, ~90%…☆24Aug 17, 2026Updated 2 months ago
- DeepSeek-V4.1-Flash on two NVIDIA DGX Sparks: EXL3 weights from the official checkpoint, upstream vLLM with our patches and decode kernel…☆42Updated this week
- Research code and optimized inference for ALoDLM: Adaptively Looped Diffusion Language Models.☆50Oct 8, 2026Updated last week
- Breaking the quadratic memory barrier in AI☆60Oct 13, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses☆127Updated this week
- Qwen3.8-Flash-Next on ONE DGX Spark (TP=1)☆614Oct 4, 2026Updated 2 weeks ago
- Cap the GPU clock on NVIDIA DGX Sparks across all your machines, persistently☆50Oct 14, 2026Updated last week
- Run the AEON Bench suite on your own hardware: verified HuggingFace pull → serve → benchmark (text · agentic ×3 harnesses · vision · audi…☆25Oct 6, 2026Updated 2 weeks ago
- DeepSeek-V4-Flash-DSpark abliterated (uncensored) · ~100% refusal bypass · C1 ~57 tok/s · 1M ctx · 2× DGX Spark · HF weights☆54Aug 17, 2026Updated 2 months ago
- Two-node DGX Spark/ASUS GX10 DeepSeek V4 Flash DSpark NVFP4 port for vLLM 0.25, with live dashboard and reproducible deployment.☆81Sep 13, 2026Updated last month
- Agent-ready two-node DGX Spark recipe for DeepSeek V4 Flash plus an optional Qwen Vision sidecar, with generic OpenAI-compatible, Hermes,…☆24Aug 10, 2026Updated 2 months ago