Fast & opinionated local AI routing: one MCP server that loads local image and video models on demand on your own GPU box (DGX Spark first)
☆10Oct 17, 2026Updated this week
Alternatives and similar repositories for localrouter
Users that are interested in localrouter are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the f…☆29Oct 7, 2026Updated 2 weeks ago
- DGX Spark (GB10/sm_121) port: DeepSeek-V4-Flash 159B on one Spark, GLM-5.2 753B across two. Prepacked 2-bit planes + unified-memory fixes…☆19Jul 20, 2026Updated 3 months ago
- Cap the GPU clock on NVIDIA DGX Sparks across all your machines, persistently☆51Oct 14, 2026Updated last week
- Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slat…☆182Updated this week
- Metal Cuda Direct Memory Access☆200Oct 15, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- EXLR8: a DGX Spark tuned quantization format☆13Updated this week
- 📊 LLM Context Benchmarks - A comprehensive benchmarking tool for testing LLMs with varying context sizes using Ollama. Features dual b…☆105Oct 15, 2026Updated last week
- A local prompt-difficulty classifier that automatically sets Pi reasoning effort.☆12Jul 3, 2026Updated 3 months ago
- Fish Audio Drama 3 text-to-speech on the TensorFold native CUDA engine for DGX Spark (GB10): recipe, engine patches, benchmarks. Built wi…☆107Updated this week
- ☆16Sep 25, 2026Updated 3 weeks ago
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆77Jul 31, 2026Updated 2 months ago
- Clean reproducible benchmark suite for the self-hosted cascade RC (ARC-AGI-2, HMMT-2026, HLE, MMMU-Pro, SWE-Bench Pro, Terminal-Bench 2.1…☆13Oct 8, 2026Updated 2 weeks ago
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆90Updated this week
- Full GLM-5.3 (753B) served by TensorFold with tensor parallel 4 across four NVIDIA DGX Sparks: results, recipe, node settings, benches☆21Oct 13, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- NVIDIA Nemotron 3.5 Lightning 30B-A3B NVFP4 + DSpark for DGX Spark, RTX 5090/6000 PRO (SGLang)☆23Aug 11, 2026Updated 2 months ago
- Vendor-neutral, LLM-maintained personal-context wiki. Markdown in your git, queryable by any LLM (HTTP API + MCP server). v0.7 prototype.☆20Sep 30, 2026Updated 3 weeks ago
- Reproducible Qwen3.8-27B NVFP4 + DFlash2 recipe and qualification evidence for one NVIDIA DGX Spark☆30Aug 21, 2026Updated 2 months ago
- AI generated safe, polished visual artifacts☆30Oct 12, 2026Updated last week
- ☆16Aug 7, 2026Updated 2 months ago
- A 21M-parameter LM with a 16.8M-row product-key memory: as good as a 114M dense model and runs with the table on an SSD. Triton kernels f…☆16Updated this week
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆49Aug 23, 2026Updated 2 months ago
- Java library to enable AfterBurn with OpenFaaS☆11Mar 31, 2018Updated 8 years ago
- Iterative decoding of turbo codes using the Soft Output Viterbi Algorithm (SOVA)☆11Feb 5, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Qwen3.6-27B (NVFP4) DFlash for DGX Spark☆22Jul 31, 2026Updated 2 months ago
- ☆10Jun 29, 2021Updated 5 years ago
- A very WIP tool for jev-ification☆42Oct 8, 2026Updated 2 weeks ago
- ☆12Jul 24, 2019Updated 7 years ago
- ☆21Jul 23, 2026Updated 3 months ago
- ☆21Aug 10, 2026Updated 2 months ago
- A Simulator for Communication Systems☆15Jul 30, 2026Updated 2 months ago
- Qwen 3.8 125B-A6B CUDA inference speedup benchmark: ds4 engine, overlay, and submission harness☆15Oct 10, 2026Updated last week
- CLI tool for managing Infomaniak services — DNS, mail, hosting, kDrive, and more.☆20Mar 15, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- WebView（Java）和JS互相调用demo☆10Dec 3, 2015Updated 10 years ago
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- Run DeepSeek-V4-Flash at full 1M context AND two MiniMax H3 video instances on the same two DGX Sparks. Benchmarked C1-C6.☆35Aug 7, 2026Updated 2 months ago
- vLLM Tune consolidates MoE and FP8 dense GEMM kernel tuning into a single command☆32May 24, 2026Updated 4 months ago
- Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validat…☆33Oct 16, 2026Updated last week
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- A minimal and extensible agent server for building agent applications☆22Updated this week