Turbo1Bit: Combining 1-bit LLM weights (Bonsai) with TurboQuant KV cache compression for maximum inference efficiency. 4.2x KV cache compression + 16x weight compression = ~10x total memory reduction.
☆31Apr 2, 2026Updated 6 months ago
Alternatives and similar repositories for Turbo1bit
Users that are interested in Turbo1bit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆26Jun 23, 2026Updated 3 months ago
- Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches☆91Aug 6, 2026Updated 2 months ago
- Decentralizing distribution of open-source AI models.☆25Updated this week
- Headless terminal emulator CLI powered by libghostty-vt☆18Apr 8, 2026Updated 6 months ago
- 1bit llama.cpp gguf weights paired with turboquant 4 bit kv cache☆24Apr 4, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- TurboQuant 3-bit KV-cache quantization for llama.cpp☆54Jul 30, 2026Updated 2 months ago
- The fastest inference framework to run AI on CPUs☆21Jun 12, 2026Updated 4 months ago
- Plugin that allows you to mentions people and transform it into links☆10Apr 11, 2024Updated 2 years ago
- Cogito Studio: All-in-One Workspace AI☆21Jul 1, 2026Updated 3 months ago
- A tiny nearest-neighbor embedding database written in C☆19Feb 18, 2026Updated 7 months ago
- Gemma 4 31B Abliterated — quality-preserving guardrail removal for Google's most capable open model. Apache 2.0. Runs on Apple Silicon vi…☆21Apr 3, 2026Updated 6 months ago
- Flan T5 LLM fine-tuning, by attaching a regression model last hidden layers activations. Runs on colab with A100 40gb☆13Mar 24, 2023Updated 3 years ago
- This is a JavaScript implementaion of ELM network but allows for more creative extensibility like deep ELM's and chained ELM's also provi…☆13Jan 16, 2026Updated 8 months ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆13Oct 7, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆29May 18, 2025Updated last year
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆69Sep 5, 2026Updated last month
- SANCTIS is a cognitive architecture that gives LLMs structured tools to organize their own reasoning, maintain long-horizon coherence, an…☆16May 29, 2026Updated 4 months ago
- LLM inference in C/C++☆923Updated this week
- AI-powered sui-move audit solution☆15May 20, 2026Updated 4 months ago
- [SC2023] POMELO: Fine-grained Population Mapping from Coarse Census Counts and Open Geodata☆13Aug 5, 2024Updated 2 years ago
- Template repository for Figma Designlets☆13May 15, 2021Updated 5 years ago
- Neural models for predicting angular choice in road networks☆12Jan 19, 2024Updated 2 years ago
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆48Apr 6, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Lossless compression using Probabilistic Circuits☆16Mar 10, 2022Updated 4 years ago
- ☆13Jun 1, 2021Updated 5 years ago
- The source code repository for the FactorBase system☆11Mar 17, 2024Updated 2 years ago
- Examples to illustrate the use of experimental OCaml macros☆13Jan 5, 2018Updated 8 years ago
- Domain specific language for modelling dynamic Bayesian networks and estimating posteriors☆13Jul 2, 2024Updated 2 years ago
- Recommendation System based on python☆14Feb 17, 2020Updated 6 years ago
- Final Solution for MAG240M dataset of OGB-LSC@KDDCUP2021☆11Jun 17, 2021Updated 5 years ago
- Fridg is a full-stack, single-page web app built with React, JavaScript, Python, Flask, PostgreSQL, SQLAlchemy, HTML, CSS, and Bootstrap …☆11Mar 5, 2021Updated 5 years ago
- Tutorials and resources for applications state-of-the-art NLP in personality assessment.☆12Mar 8, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆15Jun 21, 2026Updated 3 months ago
- This repository contains the source code for the article "Towards Feature Selection for Ranking and Classification Exploiting Quantum Ann…☆10Jul 27, 2022Updated 4 years ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- [DEPRECATED] Automated Q/A prototype☆10Jul 9, 2016Updated 10 years ago
- Code for HyPER: A Flexible and Extensible Probabilistic Framework for Hybrid Recommender Systems☆16Jun 2, 2016Updated 10 years ago
- Mechanical Turk on your own machine for chemical literature annotation☆13Feb 17, 2022Updated 4 years ago
- Fine-Tuning Gemma 3 to Speak Gen Z on a Cloud TPU using Kinetic one decorator only☆15Mar 30, 2026Updated 6 months ago