🚗 LIMCARS Local Inference Monitor · Cost Analyzer · Recipe Server
☆13Nov 5, 2026Updated last week
Alternatives and similar repositories for LIMCARS
Users that are interested in LIMCARS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Serve DeepSeek-V4-Flash-Vision EXL3 MixedK (full 256 experts) on one NVIDIA DGX Spark with vLLM — recipe, loader patches, and receipts☆14Sep 7, 2026Updated 2 months ago
- A community-owned map of LLM inference engine configurations — benchmarks, evals and coverage gaps, hosted on GitHub Pages. The repo is t…☆16Oct 19, 2026Updated 3 weeks ago
- Agentic test batteries for local models via Hermes Agent - scripted tools + real Hermes CLI sessions☆15Aug 14, 2026Updated 2 months ago
- Optimized two-node DGX Spark deployment recipe for DeepSeek V4 Flash with vLLM, DSpark, and NVFP4 KV cache☆11Aug 12, 2026Updated 3 months ago
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆77Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Eleven gnostic gospels as phone-readable PDFs, in reading order☆13Oct 20, 2026Updated 3 weeks ago
- DSV4.1-Flash-1017 SAGE EXL3 (1.62 bpw) on one DGX Spark with vLLM: DSpark MTP, cold-expert ATS alias, tile-K 16 MoE, memory guard, measur…☆42Nov 4, 2026Updated last week
- Uncensored DeepSeek-V4.1-Flash-1017 on 2x DGX Spark: refusals 94 to 6, same answers as DeepSeek's API, 2,008 tok/s prefill at 128K, 113 t…☆60Oct 27, 2026Updated 2 weeks ago
- Qwen3.8-27B on one DGX Spark GB10: DFlash 2 for 65 tok/s C1 and 120 C4; EAGLE 3/1/4 for ~191 C8, ~330 C16 and ~535 C32; native 262K, pinn…☆13Oct 6, 2026Updated last month
- Supply-chain auditor for (abliterated) GGUF & .safetensor models: chat-template tamper detection, tensor fingerprints, plain-language rep…☆12Oct 15, 2026Updated 3 weeks ago
- Chezmoi-managed dot files☆12Updated this week
- An update to the old simple-calc☆10Dec 22, 2025Updated 10 months ago
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆51Aug 23, 2026Updated 2 months ago
- Give DeepSeek V4 Flash eyes. OpenAI-compatible shim + tiny local VLM. Point any harness at one URL and your text-only model accepts image…☆30Aug 9, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆33Nov 4, 2026Updated last week
- Cake Build addin for managing (simctl) Apple iOS/watchOS/appleTV simulators☆15Dec 8, 2022Updated 3 years ago
- How I tune a cloned Drama 3 voice so spoken replies sound like talking, not reading☆15Oct 26, 2026Updated 2 weeks ago
- GLM-5.2 Quantrio INT4/INT8 Mixed Abliterated — SPEED=1 C1≈30 tok/s @ 128k on 4x DGX Spark. Step-by-step recipe, image bake, results.☆13Jul 18, 2026Updated 3 months ago
- Eight-system DGX Spark engineering: fabric repair, NCCL tuning, rack recabling, custom 3D-printed PSU supports, and thermal validation.☆11Aug 3, 2026Updated 3 months ago
- Core-to-core latency benchmark that works on Apple MacOS without hard affinity☆22Sep 29, 2026Updated last month
- Blazor, ASP.NET Core, Xamarin, .NET Standard <3☆14Dec 8, 2022Updated 3 years ago
- Conformance and capability test suite for LLM inference engines — surface coverage, spec conformance, model capability, and an MTP/perfor…☆56Oct 18, 2026Updated 3 weeks ago
- GLM-5.2 744B with a true 4-bit NVFP4 KV cache on 4x DGX Spark: 42 tok/s peak, 317K-token KV pool (+58.6% vs fp8), needle-verified at 250K…☆15Jul 21, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Model-agnostic LLM benchmarking + tuning in one command. A model is a 15-key profile file. Built in production on a 4x NVIDIA DGX Spark c…☆10Sep 16, 2026Updated last month
- DGX Spark (GB10) random hard power-off: how to diagnose the log-less crash signature and stop it with a GPU clock cap. Field-tested fix +…☆29Aug 16, 2026Updated 2 months ago
- Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090☆25Sep 20, 2026Updated last month
- MiniMax-H3 33B audio+video DiT accelerated 1.54x on a single NVIDIA DGX Spark (GB10, sm_121): NVIDIA Sol-Engine FirstBlockCache + batched…☆34Aug 17, 2026Updated 2 months ago
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆174Updated this week
- FlashAttention brought back to Tesla V100 — a deep llama.cpp fork: SM 7.0 D256 kernels, SplitKV3, q4_0 KV cache, DFlash2 speculative deco…☆19Updated this week
- CloudlessOS☆14Aug 20, 2026Updated 2 months ago
- Concurrency Patch to enable on DSpark - DeepSeek V4 Flash/Pro C=16 can be modified for more☆12Jun 29, 2026Updated 4 months ago
- Getting Qwen's Qwen4-architecture preview (Qwen3.8-Flash-Next) to run on a single DGX Spark GB10 — 125.9 GiB of weights against 117 GiB o…☆21Oct 14, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- AI assistants that do real work, built your way, on your own machine. Any model, hosted or local, from any browser or the fxbot app o…☆16Updated this week
- keys- 1M context: Inkling-Small-NVFP4 + DSpark + NVFP4 KV on SGLang, sm_121a-optimized on Two DGX Sparks — one-shot agent-executable rec…☆10Aug 17, 2026Updated 2 months ago
- Pyranid is a zero-dependency JDBC interface for modern Java applications.☆21Nov 2, 2026Updated last week
- Do multiple agents sharing a single asymmetrically-compressed KV pool produce quality output comparable to full-precision per-agent KV ca…☆13Apr 26, 2026Updated 6 months ago
- NVIDIA Nemotron 3.5 Bolt // TensorFold // DGX Spark☆13Nov 1, 2026Updated last week
- (Continuously) scans your internet facing infrastructure to discover exposed ports and services, helping you identify changes and reduce …☆12Updated this week
- DGX Spark / GB10 vLLM Docker stack for large-model serving, presets, patches, and validation notes.☆12Jun 29, 2026Updated 4 months ago
Are these results useful?