Bonsai Demo
☆2,261Aug 28, 2026Updated this week
Alternatives and similar repositories for Bonsai-demo
Users that are interested in Bonsai-demo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆469Updated this week
- Generate images locally☆531Jun 14, 2026Updated 2 months ago
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆26,468Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆16,544Aug 21, 2026Updated last week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,011Aug 18, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A TTS that fits in your CPU (and pocket)☆9,239Updated this week
- Apache Ossie, industry wide specification effort to standardize how we exchange semantic metadata across analytics, AI and BI platforms, …☆2,004Updated this week
- Official inference framework for 1-bit LLMs☆40,217Jul 27, 2026Updated last month
- 14MB foundation model for tiny devices; phones, wearables, smart home, and robots.☆9,776Updated this week
- KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44…☆1,042Apr 23, 2026Updated 4 months ago
- Anti-AI-slop design skill for Claude Code, Cursor, and Codex.☆27,545Aug 6, 2026Updated 3 weeks ago
- Lightning-Fast, On-Device, Multilingual TTS — running natively via ONNX.☆13,741Jul 24, 2026Updated last month
- Generate images locally with Bonsai 1-bit and ternary image generation models.☆29Jun 12, 2026Updated 2 months ago
- SIA is a Self Improving AI framework to autonomously improve the performance of any AI system (Model / Agent) on a benchmark task.☆2,128Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A lightweight, lightning-fast, in-process vector database☆15,540Updated this week
- Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B☆1,564Aug 14, 2026Updated 2 weeks ago
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆53,698Updated this week
- Instant, Concurrent, Secure & Lightweight Sandbox for AI Agents.☆11,389Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, FLUX and more.☆75,251Updated this week
- MLX: An array framework for Apple silicon☆57Jul 23, 2026Updated last month
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆11,572Updated this week
- Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches☆87Aug 6, 2026Updated 3 weeks ago
- ggml speech-to-text inference for 16+ model families☆1,860Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆22,024Updated this week
- The most RAM efficient harness☆18,822Updated this week
- Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization bui…☆30,094Updated this week
- Very low latency speech to text, intent recognition, and text to speech, for building voice agents and interfaces☆10,967Updated this week
- A fast, helpful, and open-source document parser☆12,204Updated this week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,816Updated this week
- LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge dev…☆6,325Updated this week
- JavaScript in-page GUI agent. Control web interfaces with natural language.☆28,906Updated this week
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆99,416Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Open-source AI coworker, with memory☆17,435Updated this week
- Skills for Design Engineers☆7,805Updated this week
- Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.☆3,331Updated this week
- LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via e…☆3,347Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,440Updated this week
- AirLLM 70B inference with single 4GB GPU☆33,177Updated this week
- The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public be…☆4,771Updated this week