Bonsai Demo
☆3,467Oct 29, 2026Updated this week
Alternatives and similar repositories for Bonsai-demo
Users that are interested in Bonsai-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆986Updated this week
- Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables,…☆14,407Oct 19, 2026Updated last week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆45,136Updated this week
- Generate images locally☆558Sep 8, 2026Updated last month
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆14,817Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,435Oct 7, 2026Updated 3 weeks ago
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆36,386Updated this week
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,458Updated this week
- AirLLM 2.8T LLM inference with single 4GB GPU☆41,316Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆31,351Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,208Aug 18, 2026Updated 2 months ago
- Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Wo…☆7,598Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆78,674Updated this week
- Official inference framework for 1-bit LLMs☆41,285Jul 27, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- High performance coding agent harness written in Rust, built for heavy multi-agent dev workflows☆21,304Updated this week
- A TTS that fits in your CPU (and pocket)☆10,126Updated this week
- ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI serv…☆7,714Updated this week
- A hive mind communication platform☆36,598Updated this week
- OpenShell is the safe, private runtime for autonomous AI agents.☆20,702Updated this week
- Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ lan…☆34,686Updated this week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆24,158Oct 23, 2026Updated last week
- Graph-Native Infrastructure for Context and Accountable AI Systems☆14,347Updated this week
- Language model tokenization at GB/s☆4,142Sep 2, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fully automatic censorship removal for language models☆37,128Updated this week
- TencentDB Agent Memory is a team-level memory hub for AI Agents — turning conversations, docs, and code into four reusable memory assets …☆30,256Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆55,961Updated this week
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,759Sep 9, 2026Updated last month
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆118,980Updated this week
- Build voice agents with open-source models☆13,599Updated this week
- LLM inference in C/C++☆132,847Updated this week
- Generate images locally with Bonsai 1-bit and ternary image generation models.☆30Jun 12, 2026Updated 4 months ago
- Turn your coding agents into research agents☆7,700Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A lightweight, lightning-fast, in-process vector database☆16,165Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,240Updated this week
- Lightpanda: the headless browser designed for AI and automation☆38,370Updated this week
- MLX: An array framework for Apple silicon☆69Oct 8, 2026Updated 3 weeks ago
- Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B☆1,584Aug 14, 2026Updated 2 months ago
- VoiceStudio is the open-source, fully-local ElevenLabs alternative — voice cloning, voice design, video dubbing, dictation, transcription…☆95,737Updated this week
- A fast, helpful, and open-source document parser☆12,950Updated this week