vLLM Docker Container for the latest Qwen 27b
☆53Sep 27, 2026Updated last month
Alternatives and similar repositories for qwen-27b-docker
Users that are interested in qwen-27b-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆119Apr 28, 2026Updated 6 months ago
- ☆15Apr 27, 2026Updated 6 months ago
- A local, multimodal embedding server and vector database using NVIDIA's Omni-Embed-Nemotron-3B. This project allows you to generate embed…☆11Nov 27, 2025Updated 11 months ago
- Diagnose vLLM inference servers☆18Jul 31, 2026Updated 3 months ago
- ☆12May 15, 2026Updated 5 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Jun 5, 2026Updated 5 months ago
- ☆12Aug 31, 2026Updated 2 months ago
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆33Aug 10, 2026Updated 3 months ago
- Qwen and DeepSeek low-VRAM LoRA training with GGUF base model, compatible with Transformers and PEFT☆22Nov 2, 2026Updated last week
- Qwen3.6-27B on dual RTX 3090 — TP=2 recipe, vLLM nightly, MTP + fp8 KV, validated for concurrent serving☆58Apr 28, 2026Updated 6 months ago
- ☆43May 4, 2026Updated 6 months ago
- SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35…☆133Sep 30, 2026Updated last month
- 🦙 Docker template for running llama.cpp llama-server in router mode with NVIDIA CUDA and AMD Vulkan GPU acceleration. Features TurboQuan…☆10Jun 25, 2026Updated 4 months ago
- Qwen3.6 27B × DFlash — 30-35 tok/s on NVIDIA DGX Spark (GB10) - LLama.Cpp☆17May 2, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Spec-driven iterative development companion CLI for OpenCode.☆19Jun 7, 2026Updated 5 months ago
- pebkac Chrome Nonautomation - A Local LLM-Driven Web Co-Browser using Smolagents, Zendriver, Trafilatura.☆81Apr 14, 2026Updated 6 months ago
- Fast cinematic video via LTX 2.3 22B. Single clips, full screenplays with character continuity, and sidechain-mixed final cuts.☆13Updated this week
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,497Updated this week
- Benchmarks, compose files, and findings for running Qwen3.6 (27B dense + 35B-A3B MoE) on 4× RTX 3090. vLLM/AWQ vs llama.cpp/GGUF, MTP spe…☆21Aug 15, 2026Updated 2 months ago
- llama-swap + a minimal ollama compatible api☆63Sep 29, 2026Updated last month
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆18May 11, 2026Updated 6 months ago
- Web based coding and computer use agent. Multi session. Voice chat. Browser use.☆23Updated this week
- StatelessChatUI is a lightweight, single-file, OpenAI-compatible chat frontend. It’s built to be portable and privacy-friendly: no accoun…☆20Dec 18, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Node.js (ESM) service that polls Gmail, sends each new email to a local OpenAI-compatible LLM, and optionally forwards summarized mobile …☆27Feb 23, 2026Updated 8 months ago
- Headless Matrix WebRTC voice AND video agent — auto-answers calls, bridges audio to any AI agent via PipeWire, optional camera-frame visi…☆20Updated this week
- Context Window Analyzer CLI - Understand what fills your LLM context window☆14Feb 3, 2026Updated 9 months ago
- Lightweight collapsible tree in 1.6k☆16May 27, 2026Updated 5 months ago
- ☆13Updated this week
- A bash script that runs local LLMs on Linux with llama.cpp, vLLM or Ollama. It plans GPU memory, checks models for security, benchmarks, …☆18Oct 27, 2026Updated 2 weeks ago
- Multi-User AI Sandboxing, Collaboration and Coding Platform☆30Oct 26, 2026Updated 2 weeks ago
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆22Oct 16, 2026Updated 3 weeks ago
- Source-available C++/CUDA inference engine for Qwen3.8-27B INT4 on 3x RTX 3090☆49Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆100Oct 20, 2026Updated 3 weeks ago
- AI Dev Ops Agent with local llm☆13Dec 15, 2025Updated 10 months ago
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 6 months ago
- A simple Gradio WebUI for loading/unloading models and loras in tabbyAPI.☆20Nov 21, 2024Updated last year
- A paperless-ngx configuration to automatically translate documents to your desired languages.☆10Oct 9, 2026Updated last month
- a truly open experimental coding harness☆19Nov 5, 2026Updated last week
- Modular, agentic framework and MCP platform you self-host. Build and run your own AI agents, connect Claude Code, Claude Desktop, or Curs…☆27Updated this week
Are these results useful?