Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode
☆74Apr 29, 2026Updated 5 months ago
Alternatives and similar repositories for qwen36-27b-single-5090
Users that are interested in qwen36-27b-single-5090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated 2 weeks ago
- ☆119Apr 28, 2026Updated 5 months ago
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆231May 14, 2026Updated 5 months ago
- Optimized cross-platform expansion of autoresearch.☆18Mar 23, 2026Updated 6 months ago
- ☆32Aug 28, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- RTX 6000 96GB/Spark 128GB vLLM Recipe for Qwen 3.8 Flash Next☆22Sep 8, 2026Updated last month
- NVFP4 inference on Blackwell GeForce (RTX 5090/5080/5070 Ti/RTX PRO 6000) — SM120 patches for vLLM + FlashInfer + CUTLASS. 175 tok/s on Q…☆26Apr 27, 2026Updated 5 months ago
- ☆21Aug 17, 2026Updated 2 months ago
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 7 months ago
- ☆31Aug 26, 2026Updated last month
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,416Updated this week
- Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partial…☆29Aug 6, 2026Updated 2 months ago
- A desktop application for macOS and Windows that allows users to select an area of their screen and receive an AI-generated description o…☆17Oct 20, 2025Updated last year
- PCG like for godot☆75Oct 8, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A set of Comfyui nodes☆21Updated this week
- ☆78Apr 1, 2026Updated 6 months ago
- Linter plugin for Lua, using `luac -p`.☆10Jul 28, 2023Updated 3 years ago
- ☆12Oct 9, 2023Updated 3 years ago
- A coding agent that drives the ChatGPT web tab you already have open — no API key, with the brakes on☆27Sep 26, 2026Updated 3 weeks ago
- Slightly better tools for random prompt generation in ComfyUI☆11Jun 9, 2025Updated last year
- Gamestate library for Löve2D with animations.☆10May 30, 2014Updated 12 years ago
- Build different debian suites for the radxa rock 4 se☆12Mar 11, 2024Updated 2 years ago
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆91Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆12Jan 29, 2024Updated 2 years ago
- open-source mac menu bar app that allows you to clip python scripts☆15Aug 9, 2026Updated 2 months ago
- Pi coding agent extension for focused code retrieval, grounded edits, safety checks, and language-server support.☆28Sep 23, 2026Updated 3 weeks ago
- Personal pi agent setup☆16Mar 16, 2026Updated 7 months ago
- React / NET 8 app for searching documents with a LLM. Uses ChromaDB, LlamaSharp, AllMiniLmL6v2Sharp, and ChromaDBSharp. No Python!☆21Dec 27, 2023Updated 2 years ago
- [NeurIPS 2025 Spotlight] Official Implementation for Spatial Understanding from Videos: Structured Prompts Meet Simulation Data☆18Jul 2, 2026Updated 3 months ago
- A top for local LLMs: memory, paging, GPU and tokens/s for oMLX, Ollama, llama.cpp, vLLM and more☆112Updated this week
- Bunnymark benchmark for Love2D☆13Jan 26, 2022Updated 4 years ago
- This project is now obsolete. Some alternatives can be found here: https://github.com/pannous/english-script and also here: https://githu…☆11Feb 10, 2014Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Portable 16:9 image presentation production skill for Codex and ChatGPT Work☆32Sep 5, 2026Updated last month
- Emulation Station for Windows 10☆11Apr 26, 2021Updated 5 years ago
- Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10☆60Updated this week
- This skill parses PDF and Word (`.docx`) documents, slices them into structured Markdown sections based on document headings, stores the …☆29Oct 9, 2026Updated last week
- DataGrip plugin to connect multiple sources into one☆12May 15, 2024Updated 2 years ago
- Native Android client for Actual Budget, with standalone offline support.☆51Updated this week
- Free local guardrail for AI coding agents: every tool_call judged on-device (regex + Laya), allow/review/block☆31Updated this week