This repo contains the critical chat_template.jinja fix for Qwen3/3.5/3.6 to work smoothly in agentic task.
☆92May 2, 2026Updated 2 months ago
Alternatives and similar repositories for vLLM-Qwen3-3.5-3.6-chat-template-fix
Users that are interested in vLLM-Qwen3-3.5-3.6-chat-template-fix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run Open Source Local AI Models in Excel with Ollama☆27Aug 11, 2025Updated 11 months ago
- 🔮 A powerful and stylish Prompt Generator powered by OpenAI and Python. Includes a built-in JSON editor, modular prompt libraries, and f…☆20Jul 12, 2025Updated last year
- Speculative Decoding Implementations: MTP, EAGLE-3, Medusa-1, PARD, Draft Models, N-gram and Suffix Decoding from scratch☆15May 2, 2026Updated 2 months ago
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆25Updated this week
- Multimodal AI studio powered by Qwen3.6-35B-A3B. End-to-end web app exposing visual reasoning, image captioning, and document understandi…☆27Apr 23, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Single-file, dependency-free live dashboard for local llama.cpp/vLLM serving — GPU, throughput, KV/ctx, model library. Stdlib Python + on…☆35Updated this week
- A simple flappy bird clone written in PHP with Laravel and ReactPHP for the terminal.☆20Jul 3, 2026Updated last week
- DFlash & TurboQuant in llama.cpp with up to 3x faster generation and 7.5x more KV cache in same VRAM☆772Updated this week
- Deploy DeepSeek V4 Flash (MoE reasoning model) on dual DGX Spark nodes with 1M token context, InfiniBand, and FP8 KV-cache☆77Updated this week
- A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively☆122Feb 22, 2026Updated 4 months ago
- A complete solution for Raspberry Pi PWM fan control, featuring a web-based dashboard to monitor CPU temperature, fan speed, and system p…☆20May 1, 2025Updated last year
- Automate your AI music video workflow with Synesthesia Engine. This local Gradio app bridges audio analysis, LLM-driven storytelling, and…☆50Apr 4, 2026Updated 3 months ago
- Circuit-level PDP-11/34 emulator☆70Apr 8, 2026Updated 3 months ago
- Mattermost is an open source platform for secure collaboration across the entire software development lifecycle..☆28Oct 20, 2025Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Local LLM inference on RTX 4050 6GB VRAM using TurboQuant llama.cpp with Qwen3.6 35B A3B GGUF☆21Updated this week
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currentl…☆1,699Updated this week
- sparkrun - launch, manage, and stop LLM inference workloads on NVIDIA DGX Spark systems☆383Updated this week
- small script for managing google scholar alert emails☆11May 6, 2023Updated 3 years ago
- OneWire lets you access 1-wire devices made by Maxim/Dallas, such as temperature sensors and ibutton secure memory. Library for arduino☆16Mar 17, 2013Updated 13 years ago
- an AI rock tumbler (orchestrator)☆44Feb 24, 2026Updated 4 months ago
- AEAD cipher based on ChaCha20 stream cipher and Poly1305 MAC☆10Feb 18, 2022Updated 4 years ago
- Just a small collection of packages for Turris OS(OpenWRT) that I build in my free time. Don't expect anything. Not even that it builds..…☆15Jun 10, 2021Updated 5 years ago
- ☆15Jan 31, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Real-time hardware and LLM inference monitoring — GPU, CPU, memory, and vLLM metrics streamed to a dashboard.☆74Updated this week
- Web UI for sparkrun — launch and monitor inference workloads on NVIDIA DGX Spark☆20Jun 16, 2026Updated 3 weeks ago
- A very simple but fast radix tree based HTTP router for PHP. Use it directly, or as a base for your own router.☆61Jul 5, 2026Updated last week
- Generic API clients based on Pydantic and protocols☆13Updated this week
- Fast LLM speculative inference server for consumer hardware.☆2,656Updated this week
- ☆72Feb 13, 2026Updated 5 months ago
- A minimal process wrapper☆14Mar 27, 2018Updated 8 years ago
- A ComfyUI integration to use LMStudio for extending prompts.☆26Apr 30, 2025Updated last year
- 3D Open World using threejs and ammojs☆18Mar 23, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆32Updated this week
- AdaLLM is an NVFP4-first inference runtime for Ada Lovelace (RTX 4090) with FP8 KV cache and custom decode kernels. This repo targets NVF…☆135Feb 15, 2026Updated 5 months ago
- Auto-tuned launcher for GGUF models on llama.cpp / ik_llama.cpp — OpenAI-compatible server with multi-GPU tensor-split, MoE expert placem…☆252Updated this week
- Tool-calling quality benchmark for LLM serving stacks. 80+ deterministic scenarios testing multi-turn orchestration, safety boundaries, a…☆196Jul 6, 2026Updated last week
- A multithreaded discrete event simulation library in C, using POSIX pthreads for parallelized trials and replications, stackful asymmetri…☆73Jul 6, 2026Updated last week
- Fourier-based text morphing demo☆19Apr 12, 2026Updated 3 months ago
- ☆23Updated this week