Turbo1Bit: Combining 1-bit LLM weights (Bonsai) with TurboQuant KV cache compression for maximum inference efficiency. 4.2x KV cache compression + 16x weight compression = ~10x total memory reduction.
☆31Apr 2, 2026Updated 4 months ago
Alternatives and similar repositories for Turbo1bit
Users that are interested in Turbo1bit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ultra-Sparse Adaptation of 1-Bit LLMs via XOR Patches☆87Aug 6, 2026Updated 3 weeks ago
- SubRISC: Simple Instruction-Set Computer for IoT edge devices☆16Jun 27, 2018Updated 8 years ago
- Headless terminal emulator CLI powered by libghostty-vt☆18Apr 8, 2026Updated 4 months ago
- The fastest inference framework to run AI on CPUs☆19Jun 12, 2026Updated 2 months ago
- Dice Language Support for VS Code☆10Sep 29, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A simple library to better manage AI prompts in your Rust code.☆14Apr 29, 2024Updated 2 years ago
- ChatGPT over SMS using Twilio Programmable Messaging, OpenAI API, Flask☆13Jan 22, 2023Updated 3 years ago
- Test your local LLMs on the AIME problems☆39Jun 7, 2025Updated last year
- Cogito Studio: All-in-One Workspace AI☆19Jul 1, 2026Updated last month
- Probabilistic Circuits in Julia☆10Dec 27, 2023Updated 2 years ago
- A tiny nearest-neighbor embedding database written in C☆19Feb 18, 2026Updated 6 months ago
- Gemma 4 31B Abliterated — quality-preserving guardrail removal for Google's most capable open model. Apache 2.0. Runs on Apple Silicon vi…☆19Apr 3, 2026Updated 4 months ago
- numpy ufuncs for vector similarity☆13Nov 26, 2023Updated 2 years ago
- Dashboard v5 Coming Soon!!☆64Feb 15, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Flan T5 LLM fine-tuning, by attaching a regression model last hidden layers activations. Runs on colab with A100 40gb☆13Mar 24, 2023Updated 3 years ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated last year
- Run the full 2.78-trillion-parameter Kimi K3 model or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVM…☆2,315Updated this week
- A simple path-tracer in Zig☆19Aug 10, 2021Updated 5 years ago
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆30May 18, 2025Updated last year
- Port of OpenAI's Whisper model in C/C++☆10Jul 12, 2023Updated 3 years ago
- SANCTIS is a cognitive architecture that gives LLMs structured tools to organize their own reasoning, maintain long-horizon coherence, an…☆16May 29, 2026Updated 3 months ago
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆48Apr 6, 2025Updated last year
- Lossless compression using Probabilistic Circuits☆16Mar 10, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Examples to illustrate the use of experimental OCaml macros☆13Jan 5, 2018Updated 8 years ago
- ZMQ API bindings for OCaml☆14Sep 20, 2011Updated 14 years ago
- A common API for finding nearest neighbors in Julia☆13Feb 26, 2026Updated 6 months ago
- The library for Replit AI☆16Aug 9, 2024Updated 2 years ago
- ☆92Jun 20, 2025Updated last year
- Tutorials and resources for applications state-of-the-art NLP in personality assessment.☆12Mar 8, 2023Updated 3 years ago
- Dataset of personal narratives with Advice Seeking Questions☆15May 10, 2019Updated 7 years ago
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated 11 months ago
- A meta-tracing JIT☆15Aug 23, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Fine-Tuning Gemma 3 to Speak Gen Z on a Cloud TPU using Kinetic one decorator only☆15Mar 30, 2026Updated 5 months ago
- A curated list of awesome Python frameworks, libraries and software.☆16Jan 29, 2019Updated 7 years ago
- ConnectK is a project offered to upper-div CS students in an Intro to AI course at UCI☆13Dec 10, 2016Updated 9 years ago
- Template for building a Github blog. Your blog is just a fork away...☆18Aug 23, 2013Updated 13 years ago
- Outbound Phone GPT is a sophisticated prototype for a context-aware agent designed to autonomously handle outbound phone calls.☆18Apr 3, 2024Updated 2 years ago
- LaTeX One page maintainable (US) resume☆15Jan 15, 2020Updated 6 years ago
- ❇️ The best modules for Markov Logic Networks condensed in one framework.☆13Dec 20, 2017Updated 8 years ago