One line of NInfer for the RTX 3090, RTX 4090 and RTX 5090, consolidated from the forks that carry it: GGUF block formats, ternary Bonsai 2, device route profiles, MTP and DFlash2.
☆119Oct 17, 2026Updated this week
Alternatives and similar repositories for ninfer-all
Users that are interested in ninfer-all are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mirai S (Qwen3.8-27B-S trellis GGUF) on a 12 GB RTX 4070: 262k q8_0 tiered cache, MTP drafting at every depth, harness-proofing, the laye…☆93Updated this week
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆454Updated this week
- ☆491Sep 7, 2026Updated last month
- ☆10Nov 24, 2016Updated 9 years ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,056Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Optimized ai-toolkit fork without local training data☆24Oct 10, 2026Updated last week
- Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith …☆187Updated this week
- A coding agent optimized to smaller LLMs☆49Oct 6, 2026Updated last week
- Formally verified 3D mesh intersection - trust 93 lines of spec, not 1000+ lines of AI-written code☆107Aug 1, 2026Updated 2 months ago
- distutils extension module - create an installer by InnoSetup.☆13Jul 28, 2015Updated 11 years ago
- Open source Web File Manager (Javascript + VueJS 2)☆11Apr 2, 2018Updated 8 years ago
- Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention pre…☆210Oct 7, 2026Updated last week
- ☆603Aug 14, 2026Updated 2 months ago
- ☆139Sep 24, 2026Updated 3 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Go command line app to exploit file upload vulnerability☆12Feb 8, 2017Updated 9 years ago
- A CP/M-inspired operating system☆48Sep 22, 2026Updated 3 weeks ago
- C++/ggml port of TRELLIS.2 stage-1 geometry (image -> watertight mesh)☆96Jun 4, 2026Updated 4 months ago
- A repository for github actions☆13Oct 5, 2026Updated last week
- Small decision models in Go☆63Oct 6, 2026Updated last week
- Application settings whose values can be updated while a project is up and running☆16Jun 29, 2012Updated 14 years ago
- Pi, the coding agent, compiled ahead of time to native code. Starts 3× sooner than Pi on Bun and uses about a third of its CPU.☆365Updated this week
- ☆393Updated this week
- Chunked video/audio sampling for ComfyUI with latent continuation, frame-accurate shot prompt rewriting, and reduced VRAM usage.☆138Sep 28, 2026Updated 2 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Strata minus the bullshit. clone, rsync to prod, compile and go☆112Updated this week
- A terminal Markdown viewer with big headings and real GFM support☆54Aug 1, 2026Updated 2 months ago
- SuperGenPass for Ruby.☆10Dec 13, 2011Updated 14 years ago
- Python binding for Fontconfig☆17Aug 3, 2026Updated 2 months ago
- A sourced model and short report: can Europe train a sovereign frontier AI model on the public compute it already owns, while gigawatt da…☆46Jun 15, 2026Updated 4 months ago
- Allows to bypass Cloudflare checks☆23Mar 31, 2025Updated last year
- A simple aesthetic scorer + pruner + website you can run to view the results from the scoring with☆16Jun 3, 2024Updated 2 years ago
- Easy Pony is a helper node that simplifies the process of adding scoring and other attributes to the core when prompting with Pony models…☆11Apr 5, 2025Updated last year
- Windows Chrome cookie database decrypt☆11Aug 31, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Browser DevTools panel for inspecting Inertia.js requests, page props, route metadata, response bodies, and client-side page state. Runs …☆35Updated this week
- Open-source security gateway & static scanner for AI agents. Enforce role-based access control (RBAC), human-in-the-loop approvals, seg…☆54Oct 5, 2026Updated last week
- A MOS SID 6581 / 8580 SID-file music audio visualizer for the browser.☆10May 7, 2023Updated 3 years ago
- ☆89Aug 1, 2026Updated 2 months ago
- Head and metadata management for Laravel applications.☆123Updated this week
- Obfuscator obfuscate using pure java bytecode virtual machine to interpret mutated java bytecodes of original java program.☆53Sep 11, 2026Updated last month
- A Terminal Markdown editor that stays rendered while you edit☆57Updated this week