devbauerflorian / qwen3.8-27b-rtx5090View on GitHub
Docker deployment of Qwen3.8-27B (NVFP4) on a single RTX 5090: Full native 256K-token context (FP8 KV) + MTP working at 120-170 tokens/s, OpenAI-compatible API via vLLM, caddy Basic-auth gateway, and Prometheus + Grafana + DCGM monitoring.
☆13Sep 5, 2026Updated 2 months ago

Alternatives and similar repositories for qwen3.8-27b-rtx5090

Users that are interested in qwen3.8-27b-rtx5090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?