☆119Apr 28, 2026Updated 5 months ago
Alternatives and similar repositories for qwen36-27b-single-3090
Users that are interested in qwen36-27b-single-3090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,416Updated this week
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆58Apr 28, 2026Updated 5 months ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated 2 weeks ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,934Updated this week
- Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode☆74Apr 29, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- RTX 6000 96GB/Spark 128GB vLLM Recipe for Qwen 3.8 Flash Next☆22Sep 8, 2026Updated last month
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- IMMA-based **FP8-as-storage** GEMM experiments for Ampere (sm_86 / RTX 3090 Ti).☆28Jan 30, 2026Updated 8 months ago
- A local commit gate: runs the linters your repo configures, and sends changed code to an LLM for review☆13Updated this week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,166Updated this week
- A tool to unlobotomize your NVIDIA card!☆32Sep 6, 2026Updated last month
- Experimental llama.cpp fork for inference research and development☆887Updated this week
- A python script which lets you ask questions OPEN AI chat GPT-3 using OPENAI API☆13Jan 31, 2023Updated 3 years ago
- Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell …☆169Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- Unlock P2P comms between consumer NVIDIA GPUs☆572Sep 16, 2026Updated last month
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆464Updated this week
- Plugin for ida pro that copies RVA under cursor to clipboard.☆18Jul 28, 2023Updated 3 years ago
- LLM inference in C/C++☆56Aug 8, 2026Updated 2 months ago
- Find the best AI models you can run☆35Updated this week
- WinDbg Symbols Caching Proxy.☆19Sep 28, 2026Updated 3 weeks ago
- A Windows share target for bringing WeChat chat archives to ChatGPT.☆41Sep 26, 2026Updated 3 weeks ago
- Easy local setup for Qwen3.8-27B Abliterated: 256K context and measured 240-300 tokens/s generation on an RTX 5090.☆32Sep 20, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- llama.cpp fork for significantly improved performance on Ampere (especially RTX 3090 / 3090 Ti): example: 95+ tok/s over a 100K-token gen…☆182Updated this week
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆120Oct 13, 2026Updated last week
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆394Updated this week
- Code to run with the Pi Hut 3D Xmas Tree on a Raspberry Pi☆16Apr 2, 2026Updated 6 months ago
- ☆14Nov 14, 2016Updated 9 years ago
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆135Updated this week
- Continuous Aggregation in Redis☆18Oct 23, 2023Updated 2 years ago
- JavaScript library for audio visualization. 📟☆18May 23, 2021Updated 5 years ago
- Component for Komodo to enable Telegram as Alerter☆17Oct 3, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Spec-driven iterative development companion CLI for OpenCode.☆19Jun 7, 2026Updated 4 months ago
- UniFi network management for AI agents: the complete Network API (73 tools) plus a gateway-SSH escape hatch, exposed as both a CLI and an…☆14Sep 11, 2026Updated last month
- DLSS 5 (Neural Rendering) em qualquer jogo, emulador ou video que apareca na tela - sem injetar nada no processo do jogo. Precisa de uma …☆50Oct 8, 2026Updated last week
- ☆11Feb 22, 2021Updated 5 years ago
- A novel approach for transformer model introspection that enables saving, compressing, and manipulating internal thought states for advan…☆35Mar 22, 2026Updated 6 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,713Updated this week
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆90Sep 28, 2026Updated 3 weeks ago