vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, /v1/responses with separated reasoning, via TheRock ROCm.
☆19Apr 26, 2026Updated 6 months ago
Alternatives and similar repositories for vllm-qwen
Users that are interested in vllm-qwen are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM Qwen 3.6-27B (AWQ-INT4) + DFlash speculative decoding on AMD Strix Halo (gfx1151 iGPU, 128 GB UMA, ROCm 7.13). 24.8 t/s single-strea…☆53May 10, 2026Updated 6 months ago
- Persistent project-scoped knowledge base for Claude Code and Codex: quick and deep research depths, contrarian pass, source-independence …☆15Jul 23, 2026Updated 3 months ago
- ☆15Oct 18, 2026Updated 3 weeks ago
- GLM-5.3-Flash with 152 of 288 experts per layer (RCO), for coding and agentic use on a home PC: recipe, mask, patches, evaluation harness☆14Oct 31, 2026Updated 2 weeks ago
- Linux retro-themed h/w monitor w/real-time telemetry & historical data. LAN-only by design.☆14Jun 17, 2026Updated 4 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Multi-GPU prefill acceleration for llama.cpp☆16Oct 23, 2026Updated 3 weeks ago
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Oct 30, 2026Updated 2 weeks ago
- ☆56Sep 1, 2026Updated 2 months ago
- Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results…☆373Updated this week
- Convert STL meshes to STEP solids with true cylinders, cones, spheres and tori☆19Oct 19, 2026Updated 3 weeks ago
- Fork of gufo-org/gufo with added support for Gemma models (31B and 26B, most quant types) and Deepseek V4.1 Flash (tested with ISTA-DASLa…☆17Updated this week
- ☆23Oct 29, 2026Updated 2 weeks ago
- What I run on my inference server: Qwen3.8-Flash-Next on two RTX 3090s, and how I got here☆18Oct 12, 2026Updated last month
- Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; D…☆24Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 2x DGX Spark (GB10) running DeepSeek-V4-Flash: dual-node FP8 TP=2 (~41 tok/s single / ~350 agg), single-node ds4, a 10-model GGUF benchma…☆30Jun 16, 2026Updated 4 months ago
- Open-source self-hosted home AI inference platform for AMD Strix Halo — multi-backend slots, OpenAI-compatible gateway, Vue 3 + FastAPI +…☆86Updated this week
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆81Sep 9, 2026Updated 2 months ago
- ONNX viewer/editor/inference☆17Nov 8, 2025Updated last year
- llama.cpp setup on dedicated AMD Strix Halo machine☆14Jul 26, 2026Updated 3 months ago
- ☆30Jul 30, 2026Updated 3 months ago
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆44Updated this week
- Qwen 3.8 Next Flash toolbox utilizing pwilkin's strix-halo llama.cpp fork☆13Sep 16, 2026Updated last month
- A little project to convert Java Jar files into MacOS applications☆11Jun 29, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Streaming privacy for LLM apps: pii-leak-benchmark (does your gateway leak PII in streams?), chunk-invariance (one-line test for split-bo…☆17Updated this week
- Skill for collaborative agent work in herdr. One agent presents, the others critique, you adjudicate.☆19Oct 14, 2026Updated last month
- Adversarial multi-model consensus protocol for Hermes Agent. Independent solve. Adversarial critique. Formal scoring. Verified synthesis.☆17Jul 16, 2026Updated 3 months ago
- From the world's largest port to the nation's first freeways to pioneering aqueducts, California's history has been defined by visionary …☆13Sep 17, 2026Updated last month
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆21Oct 16, 2026Updated 3 weeks ago
- Monitor temperature, control fan speeds, backlight color and more using WMI BIOS and the Embedded Controller. Lightweight, runs in the ba…☆15Oct 16, 2026Updated 3 weeks ago
- Using AI locally on Strix Halo hardware - a comprehensive guide for fully utilizing the local AI environment on the Minisforum MS-S1 Max …☆14Feb 17, 2026Updated 8 months ago
- Watch all Kubernetes Resources☆16Jun 16, 2026Updated 4 months ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆37Sep 28, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Revolutionizing how LLM models are stored☆15Aug 22, 2026Updated 2 months ago
- This hook integrates with Claude Code to automatically create git checkpoints (snapshots) of your code before any file modifications. It …☆15Jul 6, 2025Updated last year
- Ameoba Single key PCB variant designed for simplicity☆14Apr 17, 2023Updated 3 years ago
- Mirror of my favourite hacking Zines for the lulz, nostalgy, and reference☆12Feb 18, 2020Updated 6 years ago
- GPU + XDNA2 NPU inference for AMD Strix Halo (gfx1151): Qwen3.6-35B-A3B, Qwen3.8-27B, Qwen3.8 Flash-Next, Flint and GLM-5.3 Flash (321B M…☆94Updated this week
- Desync Recon & Exploitation☆11Nov 23, 2025Updated 11 months ago
- Technical docs to help you make you Halo Strix WORK!☆70Sep 3, 2026Updated 2 months ago
Are these results useful?