NInfer port for Qwen 3.8 27B on RTX 4090
☆180Sep 9, 2026Updated last month
Alternatives and similar repositories for ninfer-4090
Users that are interested in ninfer-4090 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Qwen3.8-27B on one RTX 4090: full native 262K context via E8 4-bit KV, up to 149 tok/s code decode with MTP3, sm_89-retuned attention pre…☆210Oct 7, 2026Updated last week
- Skill to generate the knowledge vault for projects using the Ralph loop☆70Oct 1, 2026Updated 2 weeks ago
- An experimental and feature-rich inference engine built on top of llama.cpp☆80Updated this week
- This is a LLM Gateway that mimics typesafe ai structured output. Like an imposter Jev.☆38Updated this week
- ☆39Sep 6, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- WebGPU render pipeline: baked lightmap atlas + DDGI-style probe volume, three.js r182 / TSL☆52Sep 17, 2026Updated last month
- NCM: Next Concept Modeling☆77Updated this week
- Free, open-source TradingView strategy optimizer for Chrome. Grid search, walk-forward, heatmaps. By Roboquant.☆59Sep 21, 2026Updated 3 weeks ago
- Real-time water caustics in the browser, built on three.js. Single-file lite and sandbox versions.☆180Sep 26, 2026Updated 3 weeks ago
- ☆491Sep 7, 2026Updated last month
- Open Jev implementation with custom finetuning☆134Updated this week
- ☆122Sep 25, 2026Updated 3 weeks ago
- What actually runs on an RTX 3060 12GB, if you have any card with 12GB vram, this is for you as well. measured, with commands☆163Aug 22, 2026Updated last month
- Modular prompts I use every day☆83Aug 17, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Compile an API, an MCP server, a database or a web page into a CLI your agent can run. Ten engines, one output contract, 4.1x less contex…☆24Sep 8, 2026Updated last month
- Linux /proc data in a consistent, parsed format.☆10Mar 28, 2016Updated 10 years ago
- Single neuron simulator/ prediction benchmark; uses Hodgkin-Huxley with novel mechanisms☆47Aug 12, 2026Updated 2 months ago
- Deep, Evolving Environments for Computer-Use Agents☆41Oct 9, 2026Updated last week
- A rust port of con-leche☆31Updated this week
- Hyper optimised Qwen3.8-27B inference on one RTX 3090: ReplaySSM, MTP3, reasoning effort, C1-C8 batching, and native Windows and Linux bu…☆454Updated this week
- ☆56Sep 27, 2026Updated 2 weeks ago
- Clip chaining for MiniMax H3 in ComfyUI - motion and audio genuinely continue across joins☆1,254Sep 6, 2026Updated last month
- An intuitive console agent to fine-tune AI models with little to no experience required!☆209Oct 5, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Claude's Tokenizer, Offline, Kinda☆83Sep 25, 2026Updated 3 weeks ago
- Instella MoE is a fully open state-of-the-art Mixture-of-Experts language model, trained end-to-end on AMD Instinct™ GPUs.☆80Sep 2, 2026Updated last month
- BarunLM-35M: a parameter-efficient 35M base language model trained on 5.7B tokens☆73Aug 5, 2026Updated 2 months ago
- an agent harness is just a monoid in the category of endofunctors☆40Updated this week
- The open-source brain for physical agentic devices, powered by Cloudflare Workers.☆238Aug 17, 2026Updated 2 months ago
- A self-evolving harness framework for Hermes Agent. Evolution + Critic + Verifier + Gardener cooperate to make your Hermes instance measu…☆61Jul 27, 2026Updated 2 months ago
- Various configurations for optimal Local AI usage.☆56Updated this week
- Harn is a programming language and runtime for building AI agents.☆27Updated this week
- Conformance and capability test suite for LLM inference engines — surface coverage, spec conformance, model capability, and an MTP/perfor…☆49Oct 5, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Create AI videos with Claude Code, Codex, Cursor, and Grok Build, with no extra generation fees beyond the plans you already pay for☆29Aug 9, 2026Updated 2 months ago
- Official repository of "Efficient and Effective Query Expansion for Web Search", Short Paper @ CIKM 2018☆15Nov 17, 2019Updated 6 years ago
- Sonarr | Radarr | Jackett | NZBGet | Deluge | Plex | Jellyfin | Ombi | Tautulli | Netdata | Dashmachine | FileBrowser | Lidarr | Samba |…☆11Sep 19, 2023Updated 3 years ago
- A char-level transformer trained from scratch on an $8 ESP32-S3. Not inference: the chip runs the full training loop, with backprop writt…☆89Aug 26, 2026Updated last month
- The System One harness for System One models. Run Jev and other System One models locally or directly on HarnessRouter.ai.☆194Sep 21, 2026Updated 3 weeks ago
- The open archive of how AI agents actually work. A versioned, verifiable archive of system prompts, developer instructions, tool schemas…☆74Oct 1, 2026Updated 2 weeks ago
- After the wild success of the NES emulator I'm going to attempt to make a GBA emulator☆15Oct 21, 2020Updated 5 years ago