Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quant kernel paths, CUDA toolchains, KV allocation, eval harnesses, versioning. Symptom-first, with the check that catches each.
☆135Oct 14, 2026Updated this week
Alternatives and similar repositories for model-serving-minefield
Users that are interested in model-serving-minefield are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆41Aug 16, 2026Updated 2 months ago
- Best-of-N coding agents with LLM-as-a-Verifier selection for Oh My Pi: isolated git worktrees, verifier-ranked trajectories, winner-only …☆73Oct 1, 2026Updated 2 weeks ago
- Conformance and capability test suite for LLM inference engines — surface coverage, spec conformance, model capability, and an MTP/perfor…☆49Oct 5, 2026Updated last week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆106Updated this week
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆68Sep 2, 2026Updated last month
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆90Oct 4, 2026Updated last week
- GLM-5.2 NVFP4+AQLM on 3× DGX Spark — 380k context MTP serve stack☆72Aug 2, 2026Updated 2 months ago
- Agent skill that mines your repo's history to draft a VISION.md, stress-tests it with hard hypotheticals, and iterates with you on an int…☆332Sep 2, 2026Updated last month
- Capping GPU clocks on NVIDIA GB10: -12C peak temp, -36% GPU power, ~1.6% throughput cost. Measurement harness, raw data, and the systemd …☆77Jul 31, 2026Updated 2 months ago
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆166Sep 3, 2026Updated last month
- CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark☆77Sep 4, 2026Updated last month
- An intuitive console agent to fine-tune AI models with little to no experience required!☆209Oct 5, 2026Updated last week
- Convert and Run Exl3 format LLM quant on Apple Silicon.☆58Aug 24, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Decision engine☆51Sep 24, 2026Updated 3 weeks ago
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆61Updated this week
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆80Sep 18, 2026Updated 3 weeks ago
- LLM Inference Engine for Metal and CUDA.☆1,359Updated this week
- Interactive canvas for taking an LLM apart tensor by tensor: measured INT8/INT4/FP8 error, distributions, spectra and outlier channels fo…☆75Sep 2, 2026Updated last month
- The Ecosystem of Monero☆14Mar 7, 2025Updated last year
- Anabasis: automatically solve hard-to-verify, domain-specific problems from one prompt.☆62Updated this week
- Specter — passive 13.56 MHz NFC reader/skimmer bug-sweep for Flipper Zero. Counter-surveillance EMF meter using the onboard NFC chip. No …☆109Oct 3, 2026Updated 2 weeks ago
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆94Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆81Updated this week
- A pi extension with a single tool: execute, running TypeScript in a persistent Bun evaluator. Files, shell, and subagents are expressed a…☆85Aug 18, 2026Updated last month
- A modular Python foundation for reproducible computational and autonomous laboratories. Alpha; the reference profile is simulator-only.☆107Updated this week
- Virtual filesystem overlay built on event streams for state replay and time travel☆208Sep 2, 2026Updated last month
- keys-Wasserman Slate AI Studio powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slate work…☆137Updated this week
- a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-…☆451Updated this week
- Grounded reasoning agent: Falcon Perception + Gemma 4 VLM on Apple Silicon☆28Apr 5, 2026Updated 6 months ago
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆363Sep 26, 2026Updated 3 weeks ago
- An embeddable tiered write-ahead log coordinated by nothing but S3 conditional writes☆56Sep 6, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Selfhost https://buzz.xyz☆72Jul 26, 2026Updated 2 months ago
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆87Updated this week
- An increasingly feature complete simulink standin☆126Updated this week
- Cyberful is an open-source AI Red Team for discovering, exploiting, verifying, and remediating vulnerabilities.☆139Aug 24, 2026Updated last month
- Endless OMP chat with durable history and binary summary-tree memory, inspired by OptChat☆78Updated this week
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- PGSync — Real-time PostgreSQL replication☆90Updated this week