Turbo1Bit: Combining 1-bit LLM weights (Bonsai) with TurboQuant KV cache compression for maximum inference efficiency. 4.2x KV cache compression + 16x weight compression = ~10x total memory reduction.
☆31Apr 2, 2026Updated 5 months ago
Alternatives and similar repositories for Turbo1bit
Users that are interested in Turbo1bit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Headless terminal emulator CLI powered by libghostty-vt☆18Apr 8, 2026Updated 5 months ago
- 1bit llama.cpp gguf weights paired with turboquant 4 bit kv cache☆24Apr 4, 2026Updated 5 months ago
- The fastest inference framework to run AI on CPUs☆20Jun 12, 2026Updated 3 months ago
- Dice Language Support for VS Code☆10Sep 29, 2020Updated 5 years ago
- A simple library to better manage AI prompts in your Rust code.☆14Apr 29, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Sum-product networks in Julia.☆36Dec 13, 2022Updated 3 years ago
- ChatGPT over SMS using Twilio Programmable Messaging, OpenAI API, Flask☆13Jan 22, 2023Updated 3 years ago
- Probabilistic Circuits in Julia☆10Dec 27, 2023Updated 2 years ago
- Python driver for MobilityDB☆11May 1, 2026Updated 4 months ago
- A tiny nearest-neighbor embedding database written in C☆19Feb 18, 2026Updated 7 months ago
- numpy ufuncs for vector similarity☆13Nov 26, 2023Updated 2 years ago
- Flan T5 LLM fine-tuning, by attaching a regression model last hidden layers activations. Runs on colab with A100 40gb☆13Mar 24, 2023Updated 3 years ago
- LLVM JIT Cycle Accurate Simulator for HardCaml☆13May 21, 2017Updated 9 years ago
- Scripts involved in getting data for ingredient substitutions☆16Feb 14, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KoboldCpp Smart Launcher with GPU Layer and Tensor Override Tuning☆30May 18, 2025Updated last year
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆69Sep 5, 2026Updated 2 weeks ago
- Imports OpenStreetMap data into a Neo4j graph database. Produces a simple schema that includes nodes, ways, and all properties/tags conta…☆11Apr 14, 2023Updated 3 years ago
- LLM inference in C/C++☆678Updated this week
- A curated list of just the right amount of resources on causal inference.☆14Oct 28, 2021Updated 4 years ago
- [SC2023] POMELO: Fine-grained Population Mapping from Coarse Census Counts and Open Geodata☆13Aug 5, 2024Updated 2 years ago
- DIY E-Zine and Operating System☆33May 4, 2019Updated 7 years ago
- ☆15Jan 15, 2019Updated 7 years ago
- dynamic mesoscopic traffic simulation☆12Apr 12, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This project was generated 100% by AI, with one prompt. NOTE: This neuroca project was generated in 3 hours on 3/3/2025. There are depend…☆48Apr 6, 2025Updated last year
- Lossless compression using Probabilistic Circuits☆16Mar 10, 2022Updated 4 years ago
- Domain specific language for modelling dynamic Bayesian networks and estimating posteriors☆13Jul 2, 2024Updated 2 years ago
- Recommendation System based on python☆14Feb 17, 2020Updated 6 years ago
- ZMQ API bindings for OCaml☆14Sep 20, 2011Updated 15 years ago
- A PyTorch implementation of Determinantal Point Process Likelihoods for Sequential Recommendation☆12Dec 9, 2024Updated last year
- Implementation of ExCut: Explainable Embedding-based Clustering over Knowledge Graphs☆12Jul 7, 2021Updated 5 years ago
- Fridg is a full-stack, single-page web app built with React, JavaScript, Python, Flask, PostgreSQL, SQLAlchemy, HTML, CSS, and Bootstrap …☆11Mar 5, 2021Updated 5 years ago
- The library for Replit AI☆16Aug 9, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Tutorials and resources for applications state-of-the-art NLP in personality assessment.☆12Mar 8, 2023Updated 3 years ago
- Dataset of personal narratives with Advice Seeking Questions☆15May 10, 2019Updated 7 years ago
- ☆15Jun 21, 2026Updated 3 months ago
- ☆12Nov 29, 2021Updated 4 years ago
- This repository contains the source code for the article "Towards Feature Selection for Ranking and Classification Exploiting Quantum Ann…☆10Jul 27, 2022Updated 4 years ago
- [DEPRECATED] Automated Q/A prototype☆10Jul 9, 2016Updated 10 years ago
- OCaml Bindings to MLIR☆16Dec 11, 2020Updated 5 years ago