OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.
☆137Nov 13, 2026Updated this week
Alternatives and similar repositories for oxibonsai
Users that are interested in oxibonsai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OxiCUDA replaces the entire NVIDIA CUDA Toolkit software stack with type-safe, memory-safe Rust code.☆145Nov 12, 2026Updated last week
- OxiMedia is the Sovereign Media Framework - A patent-free, memory-safe multimedia processing library written in pure Rust. Pure Rust reco…☆270Nov 12, 2026Updated last week
- A modern binary serialization library for Rust - the successor to bincode.☆21Updated this week
- OxiArc - The Oxidized Archiver Pure Rust implementation of archive and compression formats with core algorithms implemented from scratch.☆36Nov 13, 2026Updated last week
- ToRSh (Tensor Operations in Rust with Sharding) is a PyTorch-compatible deep learning framework built entirely in Rust.☆11Nov 12, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- NoSQL embedded document store for Rust☆20Updated this week
- Rust-native, modular platform for Semantic Web, SPARQL 1.2, GraphQL, and AI-augmented reasoning☆113Nov 13, 2026Updated last week
- opinionated durable object powered file-system that aims to replicate the exact node fs/promises api and make it available in workers☆13Jul 20, 2025Updated last year
- lodviz-rs is a pure-Rust data visualization library using Leptos and WebAssembly. It excels at automatic Level of Detail (LOD) management…☆14Mar 23, 2026Updated 7 months ago
- A pure Rust implementation of TensorFlow, providing a full-featured machine learning framework with Rust's safety and performance.☆18Updated this week
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Feb 18, 2025Updated last year
- 🦀 Decoder-only LLM built from scratch in pure Rust using Candle — no Python, no PyTorch. Gated DeltaNet + sparse attention, fine-grained…☆112Aug 21, 2026Updated 2 months ago
- rs3gw (Rust S3 Gateway) is an ultra-lightweight, high-throughput object storage gateway designed for AI model training and scientific com…☆26Updated this week
- High-performance, memory-safe Rust implementation of Hugging Face Transformers. TrustformeRS brings the power of transformer models to th…☆15Nov 12, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Personal fork of Kacper’s vLLM-Moet for DeepSeek V4 Flash on a single RTX PRO 6000. Shared for others to use; support is best-effort as t…☆18Aug 19, 2026Updated 3 months ago
- Rust code graph indexer with 28+ language support, MCP tools, ONNX vector embeddings, and SQLite-backed semantic analysis☆15Nov 10, 2026Updated last week
- A high-performance, in-memory vector database written in Rust, designed for semantic search and top-k nearest neighbor queries in AI-driv…☆28Updated this week
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated last year
- Ask shortgpt for instant and concise answers☆13May 7, 2023Updated 3 years ago
- miniblink go☆11Jan 7, 2024Updated 2 years ago
- A simple, lightweight Write-Ahead Log (WAL) implementation for append-only operations☆16Mar 22, 2026Updated 7 months ago
- This repository contains my daily solutions to LeetCode problems using Java. I created this as part of my preparation for coding intervie…☆10May 12, 2026Updated 6 months ago
- Rust Embedded HAL for Apache NuttX RTOS☆14May 9, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Pure Rust based LLM, VLM, VLA, TTS, OCR Inference Engine, powering by Candle & Rust. Alternate to your llama.cpp but much more simpler …☆532Updated this week
- simd swiss table based map☆37Updated this week
- RustGPT的中文版,同时做了大量改进(性能优化,多头自注意力机制等)☆16Mar 8, 2026Updated 8 months ago
- OAuth 2.0 and OpenID Connect for Rust, with FAPI 2.0 support☆16Updated this week
- A library for declaratively building Model Context Protocol servers.☆28Oct 6, 2025Updated last year
- Proof of concept for running moshi/hibiki using webrtc☆21Feb 28, 2025Updated last year
- Deep neural network from Newton vs the Machine☆16Oct 23, 2019Updated 7 years ago
- TensorLogic compiles logical rules (predicates, quantifiers, implications) into tensor equations (einsum graphs) with a minimal DSL + IR,…☆57Nov 12, 2026Updated last week
- A high-performance RAG indexing pipeline implemented in Rust using LanceDB and Candle☆30Aug 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A rust library for converting between UTF-8, UTF-16 and UTF-32 characters.☆13Jul 5, 2024Updated 2 years ago
- DataFrame library for data analysis implemented in Rust. It has features and design inspired by Python's pandas library, combining fast d…☆21Updated this week
- C++ library for a binary quadratic model☆14Jun 29, 2026Updated 4 months ago
- Actor-based DAG workflow execution engine for low-code applications and Agentic AI☆22Jul 3, 2026Updated 4 months ago
- Go vs Rust AI bot voice conversation☆28Mar 19, 2026Updated 8 months ago
- Live-proven Cloudflare Project Think contracts — each example deploys to a real Worker, proves its claim against live state, and tears it…☆13Jun 24, 2026Updated 4 months ago
- Zig AI Coding Assistant — multi-provider LLM agent CLI with tool calling☆25Feb 12, 2026Updated 9 months ago
Are these results useful?