Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving
☆58Apr 28, 2026Updated 5 months ago
Alternatives and similar repositories for qwen36-dual-3090
Users that are interested in qwen36-dual-3090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆119Apr 28, 2026Updated 5 months ago
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,431Updated this week
- ☆15Apr 27, 2026Updated 5 months ago
- Profile repo — categorized index of NVFP4 model releases, DGX Spark inference stacks, Apple Silicon MLX builds, the voice-AI stack, and t…☆41Oct 6, 2026Updated 2 weeks ago
- NVFP4 Gemma-4 26B-A4B MoE for DGX Spark — optimal recipe: DFlash n=10 (flex) on AEON vLLM Ultimate. 144 tok/s single / 1,724 peak (Coding…☆45Oct 6, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Stuff for the pi coding agent☆13Apr 20, 2026Updated 6 months ago
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆17May 11, 2026Updated 5 months ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated 3 weeks ago
- Pi extension that tracks bash tool token usage with live stats, grouping, and export☆23Feb 10, 2026Updated 8 months ago
- ☆21Aug 17, 2026Updated 2 months ago
- Codemap generates a compact, token-aware map of a codebase: files, symbols, and markdown structure. Designed for feeding context to LLMs …☆41Jan 29, 2026Updated 8 months ago
- LLM inference in C/C++☆56Aug 8, 2026Updated 2 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,942Updated this week
- ☆41Aug 16, 2026Updated 2 months ago
- A Minimalistic Search Agent☆83May 12, 2026Updated 5 months ago
- Routing-aware expert paging for memory-constrained MoE serving — a vLLM plug-in with byte-identical outputs and joint expert/KV memory al…☆15Sep 15, 2026Updated last month
- A pi extension that suggests the user's likely next prompt.☆53Oct 14, 2026Updated last week
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12May 30, 2025Updated last year
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Apr 28, 2026Updated 5 months ago
- React application framework on preact signals☆16Aug 14, 2023Updated 3 years ago
- ☆21Sep 9, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Tavern is a tavern simulator written in C and uses ncurses.☆27Sep 28, 2026Updated 3 weeks ago
- Short Python script for parsing Defender VDM signature files.☆10Sep 22, 2024Updated 2 years ago
- A library for creating a JavaScript namespace.☆10Jan 26, 2012Updated 14 years ago
- CLI port of BenchLocal quality bench packs — runs LLM behavioral evals against any OpenAI-compatible endpoint. Companion to club-3090.☆18Oct 16, 2026Updated last week
- Steel browser automation tools for the Pi coding agent.☆16Jul 29, 2026Updated 2 months ago
- ☆13Feb 21, 2026Updated 8 months ago
- Qwen3.6-35B-A3B-heretic NVFP4 + DFlash speculative decoding on DGX Spark (GB10/sm_121a). Source-built vLLM image + 7 patches + comprehens…☆146Oct 6, 2026Updated 2 weeks ago
- ☆20Oct 6, 2026Updated 2 weeks ago
- Fully uncensored, capability-enhanced abliteration of Qwen3.6-27B. NVFP4 + z-lab DFlash speculative decoding (n=12) on the unified ghcr.i…☆483Oct 6, 2026Updated 2 weeks ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Bleeding-edge ComfyUI for NVIDIA DGX Spark (GB10/Blackwell/sm_121a). CUDA 13 + SageAttention v3 (sm_121a) + NVFP4 + 14 custom-node packs …☆86Oct 6, 2026Updated 2 weeks ago
- RTX 6000 Pro Wiki — Running Large LLMs (Qwen3.5-397B, Kimi-K2.5, GLM-5) on PCIe GPUs without NVLink☆1,148Updated this week
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆61Updated this week
- A library for building advanced, optimised Ember.js apps☆25Updated this week
- OpenCore EFI folder for running macOS Sonoma or newer on the Dell Optiplex 5050 Micro Small Form Factor PC.☆15Oct 14, 2026Updated last week
- Run Hermes Agent + Claude Code locally on llama.cpp — zero API costs. A 4h / 7M-token session that would have cost $94 on Claude Opus 4.7☆32Oct 5, 2026Updated 2 weeks ago
- An MCP-enabled Qwen3 0.6B demo with adjustable thinking budget, all in your browser!☆28Jun 2, 2025Updated last year