Bonsai Demo
☆1,254Jul 15, 2026Updated this week
Alternatives and similar repositories for Bonsai-demo
Users that are interested in Bonsai-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆285Updated this week
- Generate images locally with Bonsai 1-bit and ternary image generation models.☆18Jun 12, 2026Updated last month
- Generate images locally☆494Jun 14, 2026Updated last month
- Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches☆81Apr 10, 2026Updated 3 months ago
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,028Apr 23, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- MLX: An array framework for Apple silicon☆38Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆5,476May 10, 2026Updated 2 months ago
- Turbo1Bit: Combining 1-bit LLM weights (Bonsai) with TurboQuant KV cache compression for maximum inference efficiency. 4.2x KV cache comp…☆29Apr 2, 2026Updated 3 months ago
- HRM-Text is a 1B text generation model based on the HRM architecture, strengthened by task completion and latent space reasoning.☆1,678Jun 17, 2026Updated 3 weeks ago
- ☆15Mar 10, 2026Updated 4 months ago
- nostr paid relay, but with monero decentralized, monero, nostr, relay, strfry, xmr☆33May 15, 2025Updated last year
- ☆20Updated this week
- Cuda kernels for leveraging LLM sparsity to improve throughput and decrease the memory requirements during inference and training.☆253Jun 29, 2026Updated 2 weeks ago
- 26m function call model that runs on incredibly small devices☆3,147Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Fast LLM speculative inference server for consumer hardware.☆2,659Updated this week
- The fastest inference framework to run AI on CPUs☆18Jun 12, 2026Updated last month
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆20Jun 23, 2026Updated 3 weeks ago
- A theoretical reconstruction of the Claude Mythos architecture, built from first principles using the available research literature.☆14,691May 23, 2026Updated last month
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆3,049Updated this week
- Open-source local AI platform for building, running, and extending AI systems with one unified runtime.☆25Updated this week
- Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B☆1,479Jun 17, 2026Updated last month
- Self-referential self-improving agents that can optimize for any computable task☆2,637May 9, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,108Jun 30, 2026Updated 2 weeks ago
- ☆1,087Updated this week
- Running a big model on a small laptop☆3,983Mar 19, 2026Updated 3 months ago
- High-performance C++ inference engine for Diffusion Language Models (LLaDA, SEDD, MDLM)☆16Apr 5, 2026Updated 3 months ago
- A TTS that fits in your CPU (and pocket)☆7,564Jun 23, 2026Updated 3 weeks ago
- Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆13,894Updated this week
- This repositories contains the reference implementation for the Sparse Delta Memory paper.More precisely, it contains the model definitio…☆25Jul 9, 2026Updated last week
- LLM inference in C/C++☆120,500Updated this week
- DMax: Aggressive Parallel Decoding for dLLMs☆127Jul 5, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge dev…☆5,899Updated this week
- hardware implementation of transformers running microgpt at 50k+ tkps☆760May 14, 2026Updated 2 months ago
- DiffusionBlocks: Block-wise Neural Network Training via Diffusion Interpretation☆241Feb 18, 2026Updated 4 months ago
- Open-Source Frontier Voice AI☆50,093Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆12,703Jun 10, 2026Updated last month
- talkie is a vintage language model from 1930☆946May 19, 2026Updated last month
- Hypernetworks that update LLMs to remember factual information☆779Jun 15, 2026Updated last month