OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the ternary line (TQ2_0_g128). It runs on CPU (SIMD), Apple Silicon (Metal), and NVIDIA (CUDA) without depending on llama.cpp, BLAS, or any C/Fortran runtime.
☆112Jul 13, 2026Updated this week
Alternatives and similar repositories for oxibonsai
Users that are interested in oxibonsai are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OxiMedia is the Sovereign Media Framework - A patent-free, memory-safe multimedia processing library written in pure Rust. Pure Rust reco…☆222Updated this week
- OxiONNX is a high-performance ONNX inference engine written in pure Rust. It supports 147 ONNX operators, GPU acceleration via wgpu, SIMD…☆17Updated this week
- opinionated durable object powered file-system that aims to replicate the exact node fs/promises api and make it available in workers☆13Jul 20, 2025Updated 11 months ago
- OxiCUDA replaces the entire NVIDIA CUDA Toolkit software stack with type-safe, memory-safe Rust code.☆132Updated this week
- Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches☆81Apr 10, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A pure Rust implementation of TensorFlow, providing a full-featured machine learning framework with Rust's safety and performance.☆17Updated this week
- rs3gw (Rust S3 Gateway) is an ultra-lightweight, high-throughput object storage gateway designed for AI model training and scientific com…☆22Updated this week
- In-browser semantic search demo using EmbeddingGemma and Transformers.js. No server required.☆38Jun 13, 2026Updated last month
- VoiRS is a cutting-edge Text-to-Speech (TTS), Voice Recognition, Sound framework that unifies high-performance crates from the cool-japan…☆41Updated this week
- llm_utils: Basic LLM tools, best practices, and minimal abstraction.☆47Feb 18, 2025Updated last year
- A fast, cross-platform embedded key-value storage engine with ACID, MVCC, and flash-optimized storage☆16Updated this week
- Rust wrapper for the Origin Private File System☆27Mar 27, 2026Updated 3 months ago
- ☆23Jan 3, 2025Updated last year
- A thin rusty wrapper over the YuNet face detection network (aka `libfacedetect`)☆11Aug 26, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Web Framework accelerates the development process with its flexibility & speed of use. Written as a library in C language. You can custom…☆15Dec 30, 2025Updated 6 months ago
- Screen recording, Screen sharing and Streaming tool for Linux and Windows.（桌面录屏工具、屏幕共享、推流）☆20Updated this week
- ☆20Updated this week
- Rust Embedded HAL for Apache NuttX RTOS☆14May 9, 2022Updated 4 years ago
- A general code generation tools for Go applications☆11Feb 17, 2017Updated 9 years ago
- TensorLogic compiles logical rules (predicates, quantifiers, implications) into tensor equations (einsum graphs) with a minimal DSL + IR,…☆49Updated this week
- rockorager's user-friendly shell☆15Updated this week
- NumRS2: High-Performance Numerical Computing in Rust☆50Updated this week
- ☆15Aug 9, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Cross-platform GPU LLM inference in Rust☆19Jun 24, 2026Updated 3 weeks ago
- Cross-platform GPU tensor library in Rust☆18Jul 4, 2026Updated last week
- "An optimizer custom node for ComfyUI that ensures each queue execution starts in an optimal state by clearing unused VRAM and unnecessar…☆21Jul 18, 2025Updated 11 months ago
- Windows Linked Lists in idiomatic Rust (LIST_ENTRY, SINGLE_LIST_ENTRY)☆23Oct 19, 2023Updated 2 years ago
- Penpot Copilot is your AI-powered design assistant, revolutionizing the way you create.☆16Dec 16, 2024Updated last year
- Rust implementation of Google's TurboQuant algorithm for vector quantization☆36Mar 25, 2026Updated 3 months ago
- A lean, modern, unofficial S3-compatible client for Rust.☆15Jun 23, 2026Updated 3 weeks ago
- (WIP) A GitHub API client.☆39Jun 6, 2024Updated 2 years ago
- Parsers/Encoders for ASN.1 BER/DER data☆26Jun 23, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Postgres extension running a huggingface sentence transformer model directly in a background worker☆17Mar 24, 2025Updated last year
- Slint多窗口+Tray Icon+窗口间通信☆17Oct 10, 2023Updated 2 years ago
- 🦀 Type-safe, async-first ORM for Rust. Prisma-like schema, fluent queries, multi-database support.☆16Jun 29, 2026Updated 2 weeks ago
- Django/DRF-inspired full-stack web framework for Rust☆21Updated this week
- A Model Context Protocol (MCP) library for the Zig ecosystem.☆39May 27, 2026Updated last month
- Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free…☆25Updated this week
- The Open Source Voice Agent Platform. Orchestrate ultra-low latency AI pipelines for real-time conversations over WebRTC.☆51Updated this week