Qwen3.8-27B on a single RTX 4090 (sm_89): Cinference/NInfer port with MTP speculative decoding and K8V4 KV cache
☆15Nov 1, 2026Updated 2 weeks ago
Alternatives and similar repositories for ninfer-4090
Users that are interested in ninfer-4090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A spec/test/review programming method that provides LLM managed code creation, testing, and implementation.☆33Nov 10, 2026Updated last week
- ☆11Mar 11, 2023Updated 3 years ago
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆523Oct 31, 2026Updated 2 weeks ago
- Exercise files for the book titled Functional Programming in PHP☆10Jun 11, 2022Updated 4 years ago
- ☆14Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Glyph3D but for the webbies☆13Updated this week
- ☆12Mar 31, 2025Updated last year
- BRKN Lifestyle Prompt Composer is a modular ComfyUI prompt randomizer designed to turn reusable packs into fast, varied, and controlled i…☆19Jul 20, 2026Updated 3 months ago
- Fake replacement for LINQPad API☆15Jun 16, 2016Updated 10 years ago
- ValueObjects toolkit, for making your own value objects quickly and easily☆10Nov 10, 2017Updated 9 years ago
- Ternary (2.125 bit/weight) Bonsai 2 27B on the NINFER engine — Ada sm_89, Linux. Derivative work of Neroued/ninfer; see README.☆64Oct 23, 2026Updated 3 weeks ago
- ☆15Sep 21, 2026Updated last month
- ☆10Jun 20, 2025Updated last year
- ☆14Oct 27, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Off-Path TCP Hijacking in Wi-Fi Networks via A Packet-Size Side Channel Attack.☆12Sep 12, 2024Updated 2 years ago
- Zip Prompt Language - compress heavy system prompts by ≥ 80 % token reduction☆15Jun 6, 2025Updated last year
- A Golang Text to Speech System☆17Feb 16, 2026Updated 9 months ago
- Use the GPU's idle NVENC silicon to multiply the effective bandwidth of every PCIe wire on the board☆32May 16, 2026Updated 6 months ago
- A collections package for various use cases (supports strict typing)☆17Jan 23, 2026Updated 9 months ago
- Build data-centric Hydra APIs☆13Apr 22, 2024Updated 2 years ago
- Context management proxy for AI coding agents: verbatim archive, on-demand recall, and saved engine state on supported backends.☆75Updated this week
- vibecoded vibecoding prompt manager for vibecoders☆14Jan 16, 2026Updated 10 months ago
- Local-first, LLM-agnostic memory system — hybrid retrieval (vector + lexical + graph), multi-signal ranking. Runs on 4GB RAM, CPU-only, n…☆17Oct 8, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Epic is a framework designed to keep your domain model implementation fully focused on the enterprise business that your application targ…☆14Apr 19, 2013Updated 13 years ago
- The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up to 2,000 tokens/s for many, …☆85Nov 4, 2026Updated 2 weeks ago
- ComfyUI nodes useful to Tweak Z-Image base models by adjusting specific 'slices'. These nodes break the model and the TextEncoder into ar…☆15Jan 28, 2026Updated 9 months ago
- AI coding agent for the terminal — PHP 8.4, Symfony TUI, mythology-themed☆20Updated this week
- ☆13Mar 21, 2026Updated 7 months ago
- ☆18Aug 6, 2026Updated 3 months ago
- A trait to translate Laravel migrations into SQLite safe migrations.☆14Mar 2, 2024Updated 2 years ago
- ☆16Oct 20, 2026Updated 3 weeks ago
- 1.08M cannabis club members, 985K ID scans, no authentication required — CCS Nube / PuffPal disclosure☆22Jun 29, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- All in one Gradio interface for chatterbox☆21May 31, 2025Updated last year
- NInfer port for Qwen 3.8 27B on RTX 4090☆187Updated this week
- DeepSeek-V4 in C99, streamed off NVMe. Runs the 284B Flash checkpoint from 3.2 GB of RAM, 1.81 s/token with a GPU, verified against PyTor…☆24Aug 25, 2026Updated 2 months ago
- Let Claude Code / OpenCode delegate coding tasks to parallel Codex subagents via tmux☆16Mar 25, 2026Updated 7 months ago
- .Net Library for Parsing Database Object Dependencies from T-SQL Scripts☆15Jul 30, 2024Updated 2 years ago
- LPUIF: A Lightweight Pixel-Level Unified Image Fusion Network☆11Nov 16, 2024Updated 2 years ago
- On-device voice models and SDK: voice isolation, wake words, voice activity and voiceprints. In the browser (WebAssembly), Python, Androi…☆77Nov 5, 2026Updated last week
Are these results useful?