NInfer port for Qwen 3.8 27B on RTX 4090
☆184Sep 9, 2026Updated last month
Alternatives and similar repositories for ninfer-4090
Users that are interested in ninfer-4090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention pre…☆229Oct 31, 2026Updated last week
- ☆34Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,283Updated this week
- Qwen3.8-27B on a single RTX 4090 (sm_89): Cinference/NInfer port with MTP speculative decoding and K8V4 KV cache☆14Updated this week
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆502Oct 31, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆18Oct 18, 2026Updated 2 weeks ago
- Realtime dashboard for the Halogen LLM inference server☆23Oct 20, 2026Updated 2 weeks ago
- Vision inference with transformers☆10Mar 27, 2025Updated last year
- Media(Video/Audio) Playback Enhancement for Obsidian.md☆10Jul 11, 2023Updated 3 years ago
- Memory system for LLMs that remembers everything you teach it during conversation. No reindexing, no context window limits. CPU by defaul…☆13May 2, 2026Updated 6 months ago
- Patched native-Windows build of vLLM. Three Windows-specific fixes (CPU-relay for Gloo, Qwen3 reasoning parser, wildcard model name) on t…☆28May 8, 2026Updated 5 months ago
- An experimental character turnaround animation workflow for ComfyUI, testing the IPAdapter Batch node. Made with 💚 by the CozyMantis squ…☆14Apr 4, 2024Updated 2 years ago
- VibeVoice nodes with exl3 support. Realtime inference speed on 3090☆14Feb 1, 2026Updated 9 months ago
- Obsidian plugin for creating plots, charts and graphs via Apache Echarts , Chart.js and visjs☆17May 3, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The agent-to-agent marketplace, in your agent host. Your agent lists, haggles, and closes deals for you while you live your life.☆17Jul 6, 2026Updated 4 months ago
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,601Updated this week
- This project adapts fablize's verified procedures — verification grounding, multi-story evidence gating, investigation protocol, and ear…☆17Jun 17, 2026Updated 4 months ago
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆41,381Updated this week
- Etsy MCP Server - Upload Listings, Edit Listings, All via an LLM through MCP!☆13May 7, 2025Updated last year
- ☆21Aug 17, 2026Updated 2 months ago
- ☆16Oct 9, 2023Updated 3 years ago
- Evaluation framework for GGUF☆15Apr 2, 2026Updated 7 months ago
- Running encarta 95 on the web!☆26Oct 24, 2026Updated 2 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Lightweight ternary QAT for ternary Bonsai models by Prism-ML☆16Sep 18, 2026Updated last month
- ☆11Sep 23, 2024Updated 2 years ago
- SnapRef: one-image reference adapter for Anima (asymmetric attention + reference K/V cache). Training, data generation and evaluation cod…☆62Updated this week
- Fast local meeting transcription with accurate speaker diarization — for your AI assistant or second brain.☆15Oct 29, 2026Updated last week
- Claude Code plugin — delegate bulky research & first-draft work to Google Gemini, then review and finish with Claude.☆22Oct 28, 2026Updated last week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆24Oct 13, 2026Updated 3 weeks ago
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆201Updated this week
- Collection of tips for using textgen in various ways☆20Aug 30, 2024Updated 2 years ago
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆95Sep 24, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆37Apr 26, 2026Updated 6 months ago
- experimental linux kernel modules and userspace drivers for RDMA-over-usb4/thunderbolt on consumer hardware☆75Oct 19, 2026Updated 2 weeks ago
- RLVR Testing and Training☆21Aug 28, 2025Updated last year
- GB/T mechanical CAD skills for Codex, Claude Code and AI agents: AutoCAD/MCP, 2D/3D, strict DRC, assemblies and product safety gates.☆20Jul 19, 2026Updated 3 months ago
- Exercise files for the book titled Functional Programming in PHP☆10Jun 11, 2022Updated 4 years ago
- Context management proxy for AI coding agents: verbatim archive, on-demand recall, and saved engine state on supported backends.☆57Updated this week
- Automate MITRE ATT&CK mapping for Suricata rules with AI-assisted analysis.☆14Sep 28, 2024Updated 2 years ago