Bonsai Demo
☆3,532Nov 5, 2026Updated 2 weeks ago
Alternatives and similar repositories for Bonsai-demo
Users that are interested in Bonsai-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆1,024Updated this week
- Sub-50mb agentic, voice and vision intelligence for consumer devices.☆14,823Updated this week
- Generate images locally☆561Sep 8, 2026Updated 2 months ago
- A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from…☆52,136Updated this week
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆17,313Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,498Oct 7, 2026Updated last month
- AirLLM 2.8T LLM inference with single 4GB GPU☆42,713Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,733Updated this week
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆45,872Updated this week
- Official inference framework for 1-bit LLMs☆42,189Jul 27, 2026Updated 3 months ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,247Aug 18, 2026Updated 3 months ago
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆32,671Updated this week
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,844Updated this week
- Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Wo…☆7,912Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A TTS that fits in your CPU (and pocket)☆10,353Updated this week
- High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows☆21,883Updated this week
- ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI serv…☆7,855Updated this week
- OpenShell is the safe, private runtime for autonomous AI agents.☆21,798Updated this week
- Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more☆42,150Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,791Updated this week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆24,413Nov 8, 2026Updated last week
- LLM inference in C/C++☆135,707Updated this week
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,754Sep 9, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆122,895Updated this week
- Build voice agents with open-source models☆13,751Updated this week
- A lightweight, lightning-fast, in-process vector database☆16,269Updated this week
- Generate images locally with Bonsai 1-bit and ternary image generation models.☆30Jun 12, 2026Updated 5 months ago
- Language model tokenization at GB/s☆4,157Nov 2, 2026Updated 2 weeks ago
- A hive mind communication platform☆37,596Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,398Updated this week
- Lightpanda: the headless browser designed for AI and automation☆42,245Updated this week
- The agent that grows with you☆264,685Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B☆1,589Aug 14, 2026Updated 3 months ago
- Runtime behavioral ablation for compressed LLMs. First target: Ternary Bonsai 2 27B — no weight modification or re-quantization. by OrcaR…☆596Sep 22, 2026Updated last month
- TencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets …☆31,036Updated this week
- Hundreds of models & providers. One command to find what runs on your hardware.☆39,106Updated this week
- A fast, helpful, and open-source document parser☆13,068Updated this week
- the runtime your coding agents live on☆51,857Updated this week
- LLM Inference Engine for Metal, CUDA and Vulkan.☆2,340Updated this week
Are these results useful?