This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.
☆97May 2, 2026Updated 3 months ago
Alternatives and similar repositories for vLLM-Qwen3-3.5-3.6-chat-template-fix
Users that are interested in vLLM-Qwen3-3.5-3.6-chat-template-fix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆60Jun 29, 2026Updated last month
- Bleeding edge vLLM Docker image for the NVIDIA DGX Spark (GB10 / sm_121a).☆48Updated this week
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 4 months ago
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆33Aug 10, 2026Updated 2 weeks ago
- Maic: A high-performance, MLX-optimized Local LLM server for Apple Silicon. OpenAI-compatible API for M1/M2/M3/M4 Macs and Mac Mini with …☆16Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆16Feb 21, 2026Updated 6 months ago
- ☆19Mar 19, 2026Updated 5 months ago
- ☆16Feb 3, 2026Updated 6 months ago
- ☆35Feb 6, 2026Updated 6 months ago
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆103Updated this week
- Your AI forgets everything between sessions. SAME fixes that. Local-first, no API keys, single binary.☆23Aug 13, 2026Updated last week
- A coding agent built on LLM☆35Jul 4, 2026Updated last month
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆906Updated this week
- Tool schemas get re-prefilled on every LLM request. ContextCache compiles them into a KV cache once, stores it on disk and reuses it acro…☆21Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆103Updated this week
- Official Spark Arena Recipe Registry☆61Aug 15, 2026Updated last week
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆17May 11, 2026Updated 3 months ago
- ☆23Mar 31, 2025Updated last year
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆124Feb 22, 2026Updated 6 months ago
- Lightweight request runner☆18Dec 8, 2020Updated 5 years ago
- A simpler self-hosted alternative to Open WebUI. Bring your own API keys or local models. Native Android client.☆74Updated this week
- Run shell commands in SQL prompt☆10Jul 11, 2024Updated 2 years ago
- ☆28Dec 2, 2025Updated 8 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- MCP Server for Namecheap☆19Jun 19, 2025Updated last year
- A local dual-layer memory pattern for AI agents: a compact, human-readable markdown index paired with semantic retrieval from a local vec…☆55Updated this week
- Docker configuration for running VLLM on dual DGX Sparks☆2,159Updated this week
- Single-file, dependency-free live dashboard for local llama.cpp/vLLM serving — GPU, throughput, KV/ctx, model library. Stdlib Python + on…☆70Aug 15, 2026Updated last week
- Custom Olares Market source optimized for Olares One (RTX 5090M + Core Ultra 9 275HX)☆19Jul 29, 2026Updated 3 weeks ago
- Example iOS app using the open-source combustion-ios-ble framework.☆12Aug 2, 2023Updated 3 years ago
- A Program to make the editing of .ini files more comfortable and safe.☆10Jun 26, 2018Updated 8 years ago
- SilverStripe module to allow users to "masquerade" as other users☆14May 4, 2026Updated 3 months ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆21Feb 15, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,449Updated this week
- A collection of intelligent AI agents built using Ollama, LangChain, and local LLMs — including chatbots, voice assistants, web scrapers,…☆18Jul 23, 2025Updated last year
- DFlash vLLM for DGX Spark — Plug & Play Block-Diffusion Speculative Decoding☆54Jun 28, 2026Updated last month
- AEAD cipher based on ChaCha20 stream cipher and Poly1305 MAC☆10Feb 18, 2022Updated 4 years ago
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currentl…☆2,068Updated this week
- Mirror of https://gitlab.nic.cz/turris/misc☆12Oct 20, 2021Updated 4 years ago
- Simple validator for identification numbers based on Luhn algorithm☆15Jan 8, 2026Updated 7 months ago