Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,144 context
☆87Nov 4, 2026Updated last week
Alternatives and similar repositories for ninfer-5090-windows
Users that are interested in ninfer-5090-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LlamaServer大语言模型引擎的启动器，配置集中管理..☆13Aug 7, 2026Updated 3 months ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,310Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆184Sep 30, 2026Updated last month
- C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer☆286Updated this week
- Durable local inference for Oh My Pi: NInfer + Qwen3.8 27B on one RTX 3090/4090/5090, with restart-resumable OpenAI Responses state.☆48Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- NInfer-KVMem-Async☆11Updated this week
- Ternary (2.125 bit/weight) Bonsai 2 27B on the NINFER engine — Ada sm_89, Linux. Derivative work of Neroued/ninfer; see README.☆61Oct 23, 2026Updated 2 weeks ago
- Desktop UI for the NInfer local LLM inference engine☆33Nov 2, 2026Updated last week
- Experimental Realization of Asynchronous Symbiotic Compilation in PyTorch 2.8☆16Apr 25, 2025Updated last year
- 一个为DeepSeek-Reasonix做的VS Code插件，可以一键启动Reasonix，减去手动输入启动命令。A VSCode plugin developed for DeepSeek-Reasonix allows for one-click launch of …☆57Jun 5, 2026Updated 5 months ago
- Emotion-first AI actor performance prompt skill☆36Aug 5, 2026Updated 3 months ago
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆230May 14, 2026Updated 5 months ago
- Qwen3.8-27B-NVFP4 on a Single RTX 5090 (vLLM)☆100Aug 16, 2026Updated 2 months ago
- ☆22Jun 27, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 炫彩界面库源码 v1.5.1☆12Nov 20, 2023Updated 2 years ago
- 纯本地化桌面 AI 智能体平台。Go + TypeScript + C/C++ 全栈，集成多模态对话、文生图、语音识别与合成，零 Python / 零云端依赖，全部推理本地完成。☆33Updated this week
- Terminal system monitor (TUI) that builds its layout from the hardware it actually finds — hybrid CPU clusters, GPUs, RDMA/RoCE NICs, PCI…☆17Updated this week
- ☆11Jan 29, 2026Updated 9 months ago
- A small set of unique adapters meant to bridge the dual_stream_shunt trained for guiding prompt embeddings and diffusion.☆14Nov 26, 2025Updated 11 months ago
- ComfyUI skin-tone correction nodes with bilingual UI, full-resolution exact preview, zero required extra dependencies, and optional Media…☆10Nov 1, 2026Updated last week
- Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on t…☆28May 8, 2026Updated 6 months ago
- 闲鱼 API Go 语言实现 整合 XianYuApis (Python) + goofish_api (Python) 双库功能☆17Jul 20, 2026Updated 3 months ago
- 台灣買房議價助手☆15Apr 25, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆27Oct 13, 2026Updated 3 weeks ago
- Cross-tier CPU/GPU hybrid MoE inference for SGLang (plugin, tracks upstream main)☆70Updated this week
- Codex instructions and native specialist agent profiles for delegating, verifying, and recovering local coding work. Part of the COREDO a…☆12Oct 26, 2026Updated 2 weeks ago
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆19Apr 26, 2026Updated 6 months ago
- KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.☆1,297Updated this week
- An custom launcher for Mocor5-based devices (BQ 2400/2800, Qin1s)☆14Aug 1, 2023Updated 3 years ago
- Qwen3.8-27B on 2× RTX 5090 · 1.49M KV · code/prose t/s: c1 264/216, c16 2,649/2,240 · NVFP4 + vLLM + MTP☆26Oct 21, 2026Updated 3 weeks ago
- Leverages Qwen 2.5/3 VL for prompt inversion & caption generation in ComfyUI☆51May 2, 2026Updated 6 months ago
- Reasonix 跨平台桌面自动化插件（重构版）。精准层优先（UIA/AXAPI/AT-SPI2）+ 视觉层兜底（EasyOCR），归一化坐标协议；Windows / Linux (X11) / macOS 三平台均已实现（同一套公共代码），Wayland 与未授权场景自动…☆43Aug 4, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 提示词管理器，管理你的创意☆14Jan 2, 2026Updated 10 months ago
- Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell☆869Updated this week
- ☆34Sep 22, 2026Updated last month
- 一个可视化Python环境管理工具☆34May 27, 2025Updated last year
- 🎬 AI全自动短视频引擎 — 基于 Pixelle-Video，新增 HappyHorse (DashScope) 云端文生视频。无需GPU，输入主题一键生成完整视频。Apache 2.0。☆58May 14, 2026Updated 5 months ago
- 宝塔linux服务器管理面板7.7镜像存档☆13Nov 1, 2026Updated last week
- Beautifully crafted JSON configurations to completely overhaul your Nuvio and AIOStreams UI. No more cluttered streams or double badges!☆22Updated this week
Are these results useful?