Turbo1Bit: Combining 1-bit LLM weights (Bonsai) with TurboQuant KV cache compression for maximum inference efficiency. 4.2x KV cache compression + 16x weight compression = ~10x total memory reduction.
☆29Apr 2, 2026Updated 3 months ago
Alternatives and similar repositories for Turbo1bit
Users that are interested in Turbo1bit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆20Jun 23, 2026Updated 3 weeks ago
- Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches☆81Apr 10, 2026Updated 3 months ago
- 1bit llama.cpp gguf weights paired with turboquant 4 bit kv cache☆23Apr 4, 2026Updated 3 months ago
- The fastest inference framework to run AI on CPUs☆18Jun 12, 2026Updated last month
- Headless terminal emulator CLI powered by libghostty-vt☆18Apr 8, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple library to better manage AI prompts in your Rust code.☆14Apr 29, 2024Updated 2 years ago
- ☆15Nov 30, 2024Updated last year
- introduction to dataflow analysis using julia☆14Oct 26, 2020Updated 5 years ago
- Hackable tree view for xplr☆21Jan 3, 2024Updated 2 years ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- numpy ufuncs for vector similarity☆13Nov 26, 2023Updated 2 years ago
- LLVM JIT Cycle Accurate Simulator for HardCaml☆13May 21, 2017Updated 9 years ago
- Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain w…☆143Updated this week
- The first browser MCP built for security testing. Give your AI agent a real Firefox browser and let it find vulnerabilities.☆15Mar 14, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Flan T5 LLM fine-tuning, by attaching a regression model last hidden layers activations. Runs on colab with A100 40gb☆13Mar 24, 2023Updated 3 years ago
- Repository for experiments with TensorFlow☆11Nov 25, 2015Updated 10 years ago
- ☆10May 19, 2024Updated 2 years ago
- Connect Owl with other accelerators and numerical frameworks with symbolic maths☆20Apr 11, 2022Updated 4 years ago
- Running Microsoft's BitNet via Electron, React & Astro☆62Sep 26, 2025Updated 9 months ago
- Materials for workshop "Build A Routing Web Application With OpenStreetMap, Neo4j, and Leaflet.js"☆16Sep 21, 2023Updated 2 years ago
- A simple path-tracer in Zig☆19Aug 10, 2021Updated 4 years ago
- Implementation of the Hierarchical Reasoning Model (HRM), applied to a pathfinding task, plus performance study.☆33Sep 9, 2025Updated 10 months ago
- Template repository for Figma Designlets☆13May 15, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Neural models for predicting angular choice in road networks☆12Jan 19, 2024Updated 2 years ago
- Lossless compression using Probabilistic Circuits☆16Mar 10, 2022Updated 4 years ago
- dynamic mesoscopic traffic simulation☆12Apr 12, 2022Updated 4 years ago
- Simulation of the ARM architecture written in Go.☆37Feb 24, 2017Updated 9 years ago
- ☆13Oct 31, 2021Updated 4 years ago
- The source code repository for the FactorBase system☆11Mar 17, 2024Updated 2 years ago
- ☆15Apr 14, 2021Updated 5 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆31Apr 10, 2026Updated 3 months ago
- A PyTorch implementation of Determinantal Point Process Likelihoods for Sequential Recommendation☆12Dec 9, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fridg is a full-stack, single-page web app built with React, JavaScript, Python, Flask, PostgreSQL, SQLAlchemy, HTML, CSS, and Bootstrap …☆11Mar 5, 2021Updated 5 years ago
- ZMQ API bindings for OCaml☆14Sep 20, 2011Updated 14 years ago
- OCaml client for the Redis advanced key-value store☆24May 5, 2011Updated 15 years ago
- The library for Replit AI☆15Aug 9, 2024Updated last year
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 10 months ago
- Dataset of personal narratives with Advice Seeking Questions☆15May 10, 2019Updated 7 years ago
- Yet another `llama.cpp` Rust wrapper☆12Updated this week