This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.
☆98May 2, 2026Updated 4 months ago
Alternatives and similar repositories for vLLM-Qwen3-3.5-3.6-chat-template-fix
Users that are interested in vLLM-Qwen3-3.5-3.6-chat-template-fix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆60Jun 29, 2026Updated 2 months ago
- 🔮 A powerful and stylish Prompt Generator powered by OpenAI and Python. Includes a built-in JSON editor, modular prompt libraries, and f…☆20Jul 12, 2025Updated last year
- Production ready, bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).☆48Updated this week
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 4 months ago
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆33Aug 10, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Pi coding agent extensions with code intelligence (LSP + Tree-sitter AST), semantic refactoring, code review, web/Context7 docs, and ask-…☆89Updated this week
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆16Feb 21, 2026Updated 6 months ago
- Speculative Decoding Implementations: MTP, EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch☆15May 2, 2026Updated 4 months ago
- ☆16Feb 3, 2026Updated 7 months ago
- ☆35Feb 6, 2026Updated 7 months ago
- Multimodal AI studio powered by Qwen3.6-35B-A3B. End-to-end web app exposing visual reasoning, image captioning, and document understandi…☆28Apr 23, 2026Updated 4 months ago
- Your AI forgets everything between sessions. SAME fixes that. Local-first, no API keys, single binary.☆23Sep 3, 2026Updated last week
- Review Pi agent work, run visible tmux workers, and save evidence outside model context☆17Aug 10, 2026Updated last month
- Give text-only LLMs vision. A tiny OpenAI-compatible proxy that lets reasoning models (DeepSeek, Qwen, GLM…) see images by querying a sep…☆49Jul 7, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,073Updated this week
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆106Aug 20, 2026Updated 3 weeks ago
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆58Apr 28, 2026Updated 4 months ago
- ☆23Mar 31, 2025Updated last year
- ☆196Sep 2, 2026Updated last week
- Page Blocks Module for SilverStripe☆13Nov 14, 2018Updated 7 years ago
- ☆28Dec 2, 2025Updated 9 months ago
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆17May 11, 2026Updated 4 months ago
- A local dual-layer memory pattern for AI agents: a compact, human-readable markdown index paired with semantic retrieval from a local vec…☆55Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Docker configuration for running VLLM on dual DGX Sparks☆2,263Updated this week
- Automate your AI music video workflow with Synesthesia Engine. This local Gradio app bridges audio analysis, LLM-driven storytelling, and…☆54Aug 16, 2026Updated 3 weeks ago
- Adds a user editable 'MetaTitle' field to pages☆16Feb 9, 2026Updated 7 months ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆21Feb 15, 2026Updated 6 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,650Updated this week
- DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding☆54Jun 28, 2026Updated 2 months ago
- Real-time voice conversation system with Sesame CSM, featuring web-based audio visualization and GPU acceleration. Educational implementa…☆17Mar 18, 2025Updated last year
- recipe for running Qwen3.8-Flash-Next on a single DGX Spark☆219Updated this week
- Mirror of https://gitlab.nic.cz/turris/misc☆12Oct 20, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currentl…☆2,228Updated this week
- Just a small collection of packages for Turris OS(OpenWRT) that I build in my free time. Don't expect anything. Not even that it builds..…☆15Jun 10, 2021Updated 5 years ago
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems. Live support: https://discord.com/invite/GH5kRg…☆505Updated this week
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆31Jul 8, 2026Updated 2 months ago
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆176Updated this week
- SilverStripe Field for selecting YouTube videos. Takes various URL formats as input and stores the YouTube ID☆15Sep 9, 2022Updated 4 years ago