Desktop UI for the NInfer local LLM inference engine
☆33Nov 2, 2026Updated this week
Alternatives and similar repositories for ninfer-studio
Users that are interested in ninfer-studio are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13May 20, 2026Updated 5 months ago
- 在 8 GB 显存的显卡上跑 35B MoE(Cyber-Tiel-Coder-35B-A3B):专家权重流式上卡、未命中专家由 CPU 池就地计算。Strata 引擎的 fork(MIT)。RTX 4080S 实测 8 GB 档 57.7–63.5 tok/s、全常驻 1…☆29Oct 10, 2026Updated 3 weeks ago
- C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer☆280Updated this week
- MiniMaxH3_LatentUpscaler for ComfyUI☆38Sep 21, 2026Updated last month
- ☆18Apr 10, 2026Updated 6 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- 抖音作品获取 skill v3.1:分享文本/短链/ID 单入口解析,按需下载图/视频/实况/文案/BGM,带元数据、SHA256 与显式状态;适用 Claude Code / Codex / Cursor / OpenClaw☆20Oct 4, 2026Updated last month
- ComfyUI custom node: run MiniMax H3 at near-fp16 speed with near-fp32 numerical stability on GPUs without bf16/fp8 hardware (V100 sm_70)☆19Aug 22, 2026Updated 2 months ago
- Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,14…☆86Updated this week
- ninfer-ext: Forked for speed.☆26Oct 22, 2026Updated 2 weeks ago
- Run Qwen3.8-27B at 140 tok/s on a single RTX 3090, up to 2x llama.cpp. Fast local LLM inference server with OpenAI- and Anthropic-compati…