C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer
☆275Nov 6, 2026Updated this week
Alternatives and similar repositories for Infernix
Users that are interested in Infernix are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell☆694Updated this week
- Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants…☆224Oct 24, 2026Updated last week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆16Oct 24, 2026Updated last week
- Run GLM-5.3-Flash (321B), DeepSeek-V4.1-Flash (748B) and MiniMax-M3.1-Flash (428B) on your own GPUs - one engine, one dashboard, OpenAI- …☆2,585Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,269Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆196Updated this week
- Xolotl (formerly Strata-DSV4.1): run DeepSeek-V4.1-Flash, all 552B, as a local coding agent on one gaming PC (RTX 4090 + 90 GB RAM) at up…☆467Updated this week
- Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith …☆887Updated this week
- Code for Latent Sparse Attention: Towards Subquadratic Ultra-Long Context Attention☆421Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆186Sep 30, 2026Updated last month
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆40,925Updated this week
- The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up to 2,000 tokens/s for many, …☆58Updated this week
- ☆10Oct 4, 2026Updated last month
- SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding☆168Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Moss-Image-Edit (image editing LoRA) on ComfyUI's native MOSS-Image: stock loaders, LoRA loader, samplers and memory management, referenc…☆19Oct 25, 2026Updated last week
- Qwen3.8-Flash-Next (MoE) and Qwen3.8-27B on one or two 16 GB RTX 50-series GPUs: experts offloaded to CPU, two-GPU tensor parallel. 64 GB…☆134Updated this week
- Qwen3.8-Flash-Next (125B MoE) up to 1M context on one or two RTX cards (tuned on 3080 10gb). A measured, tuned and benchmarked fork of …☆43Updated this week
- Strata for a PC with two NVIDIA GPUs and 32 GB of RAM: the low-RAM mode on a layer split, both cards working at the same time. 143 tok/s …☆84Oct 6, 2026Updated last month
- Native Windows port of NInfer engine for RTX 5090. Features Qwen3.8-27B with QUASAR and NInfer models, MTP/DFlash2 with vision and 262,14…☆86Updated this week
- ☆11Oct 18, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next (180B MoE) on one 12-16 GB NVIDIA GPU, Linux or Windows. Own engine, own compression.☆34Oct 21, 2026Updated 2 weeks ago
- Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when …☆2,580Updated this week
- PROMETHEVS: run the full DeepSeek-V4.1-Flash-1017 (510 GB) on a gaming PC with 64 GB RAM and a 12 GB GPU. PROMETHEVS engine (compress-the…☆110Oct 23, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- high-performance linear attention kernel library built on TileLang☆15Jun 8, 2026Updated 4 months ago
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆502Updated this week
- Statistically-Lossless Quantization of Large Language Models☆61Oct 8, 2026Updated 3 weeks ago
- AI coding agent that makes a team of small models beat a frontier one☆372Updated this week
- LLM inference in C/C++☆471Updated this week
- Experimental llama.cpp fork for inference research and development☆900Updated this week
- Delta Inference Engine: DeepSeek-V4.1-Flash on one NVIDIA GPU, natively on Windows (OpenAI-compatible server)☆65Updated this week
- An experimental and feature-rich inference engine built on top of llama.cpp☆83Updated this week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆24Oct 15, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The fastest vLLM build for AMD R9700's. For the latest updates join the Launch80 discord server. I am on X now also https://x.com/bkuyp…☆192Oct 13, 2026Updated 3 weeks ago
- HRX, LOOM, Mac, and AMD running top speed kernels with a self optimizing engine.☆34Oct 12, 2026Updated 3 weeks ago
- Reference-driven Web 3D modeling skill for AI coding assistants: geometry, materials, lighting, procedural assets, and dynamic video veri…☆18Sep 6, 2026Updated 2 months ago
- Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and h…☆288Updated this week
- A single agent turn as a unix pipe.☆16Aug 27, 2026Updated 2 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆1,794Updated this week
- ☆27Sep 11, 2026Updated last month