TandemEngine: local inference that drafts and verifies its own tokens, behind an OpenAI-compatible API.
☆82Nov 18, 2026Updated this week
Alternatives and similar repositories for TandemEngine
Users that are interested in TandemEngine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Serve DeepSeek-V4-Flash-Vision EXL3 MixedK (full 256 experts) on one NVIDIA DGX Spark with vLLM — recipe, loader patches, and receipts☆14Sep 7, 2026Updated 2 months ago
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆65Oct 14, 2026Updated last month
- A community-owned map of LLM inference engine configurations — benchmarks, evals and coverage gaps, hosted on GitHub Pages. The repo is t…☆16Oct 19, 2026Updated last month
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆60Nov 11, 2026Updated last week
- Qwen3.8 Flash-Next (NVFP4) on NVIDIA Flare for one DGX Spark / ASUS GX10: greedy, 8-agent speculative decoding, mixed prefill☆18Nov 13, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Qwen3.8 Flash Next on one DGX Spark (TensorFold)☆427Updated this week
- Recipe (profiles + docs) to serve Qwen3.8-Flash-Next on 1 or 2 DGX Sparks with the Zig TensorFold engine + Compute Lanes. Engine: github.…☆17Updated this week
- 🚗 LIMCARS Local Inference Monitor · Cost Analyzer · Recipe Server☆13Nov 13, 2026Updated last week
- qwen38-flash-next recipe for solo GB10☆177Oct 30, 2026Updated 3 weeks ago
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆95Nov 3, 2026Updated 2 weeks ago
- DeepSeek-V4.1-Flash on a single DGX Spark (GB10): resident hot experts + NVMe streaming, DSpark, OpenAI API. Work in progress.☆131Sep 16, 2026Updated 2 months ago
- Self-hosted live telemetry, alerts and benchmarks for NVIDIA DGX Spark (GB10) clusters☆12Updated this week
- Inference engine with adaptive expert loading. DeepSeek V4.1 Flash, GLM 5.3 Full and GLM 5.3 Flash, Inkling 2 small.☆54Updated this week
- Supply-chain auditor for (abliterated) GGUF & .safetensor models: chat-template tamper detection, tensor fingerprints, plain-language rep…☆12Oct 15, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆178Updated this week
- glm53-flash recipe for tp=2 GB10☆18Oct 29, 2026Updated 3 weeks ago
- vLLM recipe: GLM-5.3-Flash EXL3 K2 on one DGX Spark GB10. Native MTP k=2. Measured tok/s.☆26Sep 10, 2026Updated 2 months ago
- Serving 4-bit Qwen3.8-27B on a single DGX Spark (GB10): 75 tok/s single-stream, 246 tok/s aggregate at 8-way concurrency. NVFP4 vs MixedI…☆51Sep 29, 2026Updated last month
- Local-first AI workbench for OCR, transcription, translation, image generation, mind maps and composable workflows. Built for DGX Spark.☆70Sep 2, 2026Updated 2 months ago
- GLM-5.3 Flash on one NVIDIA GB10 (DGX Spark / ASUS GX10). GR8 turn-tail and TensorFold Mosaic recipes with launchers, benchmarks and raw …☆47Updated this week
- Serve the official Ling-3.0-flash INT4 on one NVIDIA DGX Spark, 38.7 tok/s, faster than the community GGUF. Recipe, watchdog, benchmarks.☆26Aug 29, 2026Updated 2 months ago
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆21Nov 13, 2026Updated last week
- An in-app browser pane for DeepSeek Harness — real Chrome over CDP, plus rendered previews of local files, markdown and PDFs.☆16Sep 28, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Concurrency Patch to enable on DSpark - DeepSeek V4 Flash/Pro C=16 can be modified for more☆12Jun 29, 2026Updated 4 months ago
- Ornith-1.5-122B (EXL3-EAQ) on one DGX Spark with TensorFold☆23Oct 21, 2026Updated 3 weeks ago
- Pinned stock Qwen3.8-27B NVFP4 + DFlash2 recipe and measured evidence for one NVIDIA DGX Spark☆21Nov 11, 2026Updated last week
- qwen38-flash-next recipe for tp=2 GB10☆135Oct 29, 2026Updated 3 weeks ago
- Run Qwen3.8-Flash-Next (180B) on a single DGX Spark by keeping its 51B n-gram embedding table on NVMe☆125Aug 30, 2026Updated 2 months ago
- ReAlign models instantly, on demand. Per-request alignment for verified users and channels, or Always On. Use directly or with Hermes, Op…☆126Updated this week
- Time-boxed passwordless sudo for agents. Grants expire on a systemd timer, validated with visudo before install, audited with sudoreplay.☆27Sep 3, 2026Updated 2 months ago
- Plain-language web remote control for a fleet of ComfyUI instances (Qwen-Image-2.1 stills, MiniMax-H3 video). Stdlib Python, no dependenc…☆47Oct 9, 2026Updated last month
- DSV4.1-Flash-1017 SAGE EXL3 (1.62 bpw) on one DGX Spark with vLLM: DSpark MTP, cold-expert ATS alias, tile-K 16 MoE, memory guard, measur…☆42Nov 4, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- DeepSeek-V4.1-Flash on 2x NVIDIA DGX Spark with the TensorFold engine: 1.8-1.9x code, 2.5x multi-stream, 1.7-1.95x prefill vs the vLLM ki…☆148Updated this week
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆166Updated this week
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆34Nov 4, 2026Updated 2 weeks ago
- Qwen3.8-27B on one DGX Spark GB10: DFlash 2 for 65 tok/s C1 and 120 C4; EAGLE 3/1/4 for ~191 C8, ~330 C16 and ~535 C32; native 262K, pinn…☆13Oct 6, 2026Updated last month
- SparkGLM Atlas engine: Enntity's fork of Mango-kid/atlas (Atlas-Inf/atlas), AGPL-3.0☆12Updated this week
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆434Updated this week
- DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)☆31Aug 3, 2026Updated 3 months ago
Are these results useful?