This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.
☆96May 2, 2026Updated 3 months ago
Alternatives and similar repositories for vLLM-Qwen3-3.5-3.6-chat-template-fix
Users that are interested in vLLM-Qwen3-3.5-3.6-chat-template-fix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.5-122B-A10B on a DGX Spark with DFlash speculative decode. One-shot Docker/vLLM installer. 80+ tok/s!☆54Jun 29, 2026Updated last month
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 3 months ago
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆31Jul 26, 2026Updated last week
- Speculative Decoding Implementations: MTP, EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch☆15May 2, 2026Updated 3 months ago
- ☆19Mar 19, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆35Feb 6, 2026Updated 5 months ago
- Multimodal AI studio powered by Qwen3.6-35B-A3B. End-to-end web app exposing visual reasoning, image captioning, and document understandi…☆27Apr 23, 2026Updated 3 months ago
- Mixed-precision quantization for LLMs. Every layer refracts into a different format based on its sensitivity. Native compressed-tensors e…☆98Updated this week
- Give text-only LLMs vision. A tiny OpenAI-compatible proxy that lets reasoning models (DeepSeek, Qwen, GLM…) see images by querying a sep…☆43Jul 7, 2026Updated 3 weeks ago
- Review Pi agent work, run visible tmux workers, and save evidence outside model context☆17Jul 25, 2026Updated last week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆829Updated this week
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆56Apr 28, 2026Updated 3 months ago
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆16May 11, 2026Updated 2 months ago
- ☆166Jun 14, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A simpler self-hosted alternative to Open WebUI. Bring your own API keys or local models. Native Android client in closed beta.☆70Updated this week
- ☆16Updated this week
- A collection of private CoreGraphics and SkyLight routines.☆11Feb 23, 2022Updated 4 years ago
- ABES Podcast Website☆10Aug 26, 2024Updated last year
- A transparent (O)llama proxy with model deployment aware routing which auto-manages multiple (O)llama instances in a given network.☆20Apr 14, 2026Updated 3 months ago
- zer0dex is a local dual-layer memory pattern for AI agents: a compressed, human-readable markdown index plus a vector store queried autom…☆55Jul 25, 2026Updated last week
- Automate your AI music video workflow with Synesthesia Engine. This local Gradio app bridges audio analysis, LLM-driven storytelling, and…☆54Apr 4, 2026Updated 3 months ago
- Docker configuration for running VLLM on dual DGX Sparks☆1,944Updated this week
- Reactive AI - RxLM: Reactive Language Models - training and inference framework. Part of RxNN Platform Ecosystem. Licensed under custom "…☆25May 27, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Custom Olares Market source optimized for Olares One (RTX 5090M + Core Ultra 9 275HX)☆19Updated this week
- SilverStripe module to allow users to "masquerade" as other users☆14May 4, 2026Updated 2 months ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆20Feb 15, 2026Updated 5 months ago
- Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc☆5,251Updated this week
- Font Awesome Icon Picker Field for SilverStripe 3.x based on http://mjolnic.com/fontawesome-iconpicker☆12Nov 24, 2016Updated 9 years ago
- Real-time voice conversation system with Sesame CSM, featuring web-based audio visualization and GPU acceleration. Educational implementa…☆17Mar 18, 2025Updated last year
- Local LLM inference on RTX 4050 6GB VRAM using TurboQuant llama.cpp with Qwen3.6 35B A3B GGUF☆22Jul 10, 2026Updated 3 weeks ago
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currentl…☆1,868Updated this week
- FL DiffVSR - Diffusion-based video super-resolution nodes for ComfyUI. 4x upscaling with temporal coherence using Stream-DiffVSR.☆24Apr 25, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆31Jul 8, 2026Updated 3 weeks ago
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems☆421Updated this week
- ik_llama.cpp's Thireus fork with release builds for macOS/Windows/Ubuntu CPU, Vulkan and CUDA☆167Updated this week
- AlsoAsked MCP Server☆15Jun 9, 2025Updated last year
- Демонстрация применения интерфейсов в конфигурациях 1С☆11Oct 18, 2018Updated 7 years ago
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆85Jul 28, 2026Updated last week
- MiniMax M2 inference server for NVIDIA DGX Spark☆17Jan 24, 2026Updated 6 months ago