Bonsai-27B x NInfer local deployment project (RTX 5080, ternary quantization)
☆51Oct 6, 2026Updated last month
Alternatives and similar repositories for Bonsai-27B-NInfer
Users that are interested in Bonsai-27B-NInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Oct 20, 2026Updated 2 weeks ago
- Automatically enables TensorFloat-32 (TF32) acceleration for NVIDIA RTX 30/40/50 series GPUs in ComfyUI.☆12Mar 10, 2026Updated 7 months ago
- Ternary (2.125 bit/weight) Bonsai 2 27B on the NINFER engine — Ada sm_89, Linux. Derivative work of Neroued/ninfer; see README.☆61Oct 23, 2026Updated 2 weeks ago
- Qwen3.8-27B in native NVFP4/FP8 on 2x PCIe Tesla V100-32GB (SM70): the PCIe runbook for v100-skinny + 1Cat-vLLM, with the 3 fixes that ma…☆16Sep 13, 2026Updated last month
- ☆554Oct 20, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- dsh插件版herta☆24Oct 30, 2026Updated last week
- ☆103Updated this week
- High-performance single-GPU inference for RTX 5090 Mobile.☆21Oct 4, 2026Updated last month
- ☆13Oct 14, 2026Updated 3 weeks ago
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆44Mar 17, 2026Updated 7 months ago
- KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.☆1,278Updated this week
- ☆19Oct 29, 2026Updated last week
- Implementation of BitNet-1.58 instruct tuning☆33Apr 14, 2024Updated 2 years ago
- AMD MI210 (gfx90a/CDNA2) LLM inference optimization — TurboQuant, KIVI, per-layer KV types, FlashAttention, MoE expert caching☆15Aug 25, 2026Updated 2 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Unofficial native ComfyUI adapter for Qwen-Image 2.1 Fun-Acc four-step PDD: LoRA, full norms, per-step heads and exact sigmas.☆11Sep 24, 2026Updated last month
- 您的跨端全平台私有化云微信☆13Dec 27, 2025Updated 10 months ago
- ☆15Aug 23, 2026Updated 2 months ago
- 🚀 Python聊天群日志魔法师：让繁杂群聊变成精华笔记！自动提取、智能总结，多种输出格式随心选，告别信息焦虑，轻松捕捉每一个闪光时刻！💫☆13Jun 16, 2025Updated last year
- ☆63Sep 26, 2026Updated last month
- Custom node for spliting a multiline string in 12 outputs. Very specific, for personal use.☆12Jul 25, 2025Updated last year
- NInfer for Windows and around 16GB VRAM: RTX 5070 Ti / 5080 / 5090, Qwen3.8-27B GSQ-RCO Q3, CUDA 13 Native engine, tray manager, model co…☆64Oct 1, 2026Updated last month
- 这是一个面向 OpenClaw 的微信通路插件，提供两条接入能力：一条是 基于扫码登录和 AGP WebSocket 的双向消息通道，另一条是面向微信服 务号/企业微信风格回调的 HTTP webhook 通道。项目核心目标是把外部 微信消息接入 OpenCla…☆14Mar 10, 2026Updated 7 months ago
- use rag with model in comfyui☆72Jul 14, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Unlock the Structure of Your Knowledge.A system to visualize knowledge points as a Directed Acyclic Graph (DAG) by analyzing markdown not…☆13Oct 5, 2026Updated last month
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- Experimental implementation of DeepSeek v4 flaash in llama.cpp☆24Apr 30, 2026Updated 6 months ago
- PDF_Listen_Book 是一个创新的工具，旨在将 PDF 文档转换为可听的音频内容。这个项目结合了 PDF 文本提取、自然语言处理和文本转语音技术，为用户提供了一种新颖的方式来"阅读"PDF文档。☆13Sep 30, 2024Updated 2 years ago
- A tool for latency testing of IP/IP segments/domain names using UDP/TCP/Ping methods ----- 用于对IP/IP段/域名进行UDP/TCP/Ping方式的延迟测试工具☆12Aug 26, 2025Updated last year
- This repository contains a QSAR model that predicts the ability of a chemical compound to inhibit the gene associated with Alzheimer's, B…☆11Oct 1, 2021Updated 5 years ago
- Production-grade convergence & anti-overthinking steering extension for Pi Coding Agent (tuned for Bonsai 2 / Qwen)☆18Sep 21, 2026Updated last month
- Bh3-Elysian-Realm 攻略数据索引库☆10Nov 1, 2026Updated last week
- Cursor 汉化计划☆19Aug 7, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Native Compose-like declarative Rust UI toolkit for desktop, Android & web with a WGPU renderer☆11Updated this week
- LAAP（Living Agent Application Protocol）不是一个框架，不是一个库，不是一个 APP，也不是一个操作系统。它是一套定义数字生命的开放工业标准协议，是下一代软件的底层基础设施，是软件 3.0 时代的通用语言。 它定义了数字生命从诞生、成长、…☆37Sep 24, 2026Updated last month
- The present study is finalised to determine the most advanced models in the literature capable of producing new high-quality molecules st…☆10Aug 31, 2021Updated 5 years ago
- Evaluation of Reinforcement Learning in Transformer-based Molecular Design☆11Mar 11, 2024Updated 2 years ago
- apkgen – CLI tool for Termux to generate Android APKs from a template: clone, rename package, restructure source, build debug/release.☆18Oct 28, 2026Updated last week
- Workshops on Computational Biology organized by our lab☆10Mar 25, 2024Updated 2 years ago
- LLM inference in C/C++☆34Jan 27, 2026Updated 9 months ago