Efficient non-uniform quantization with GPTQ for GGUF
☆68Sep 17, 2025Updated last year
Alternatives and similar repositories for gptq-gguf-toolkit
Users that are interested in gptq-gguf-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆47Jun 14, 2026Updated 5 months ago
- ☆18Jun 16, 2026Updated 5 months ago
- Code for DASH, a faster alternative to Distributed Shampoo via block stacking.☆13Feb 18, 2026Updated 9 months ago
- Official implementation of the paper "Agentic Backdoors via Pretraining Poisoning"☆18Updated this week
- ☆130Mar 18, 2026Updated 8 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- Thin wrapper around GGML to make life easier☆49Jul 26, 2026Updated 3 months ago
- Pytorch distributed backend extension with compression support☆17Mar 24, 2025Updated last year
- ☆96Jun 20, 2025Updated last year
- ☆127Feb 26, 2026Updated 8 months ago
- 📄Small Batch Size Training for Language Models☆89Mar 18, 2026Updated 8 months ago
- ☆18Jul 1, 2025Updated last year
- (AAAI 2026) First-Order Error Matters: Accurate Compensation for Quantized Large Language Models☆18Apr 16, 2026Updated 7 months ago
- ☆16Feb 6, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆65Jul 10, 2025Updated last year
- Compute Where It Counts: Scaling both speed and quality with training compute☆13Sep 18, 2025Updated last year
- Code for data-aware compression of DeepSeek models☆75Dec 11, 2025Updated 11 months ago
- Work in progress.☆82Nov 25, 2025Updated 11 months ago
- Evalution: evolve your LLMs with better evals.☆17Nov 6, 2026Updated last week
- ☆54May 20, 2025Updated last year
- ☆18Jun 22, 2026Updated 4 months ago
- ☆200Jun 22, 2025Updated last year
- Quantized LLM training in pure CUDA/C++.☆267Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official implementation of NOSA (EMNLP 2026 main)☆20Sep 28, 2026Updated last month
- [ICML 2026] Reproduction package for AutoBaxBuilder, a framework to build new BaxBench tasks from scratch☆14May 20, 2026Updated 5 months ago
- Fully chunked KL-Loss kernel, that massively reduces VRAM usage☆20Aug 10, 2026Updated 3 months ago
- Landing repository for the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"☆48May 13, 2026Updated 6 months ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Nov 3, 2023Updated 3 years ago
- ☆17Jul 9, 2026Updated 4 months ago
- Efficient Knowledge Injection in LLMs via Self-Distillation (TMLR)☆13Aug 5, 2025Updated last year
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆205Sep 2, 2026Updated 2 months ago
- Rust + Python implementation of the jzip spherical compression format for embeddings☆11Feb 21, 2026Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Statistically-Lossless Quantization of Large Language Models☆64Oct 8, 2026Updated last month
- This repository contains the training code of ParetoQ introduced in our work "ParetoQ Scaling Laws in Extremely Low-bit LLM Quantization"☆137Oct 15, 2025Updated last year
- ☆613Oct 29, 2024Updated 2 years ago
- Ward: Provable RAG Dataset Inference via LLM Watermarks (ICLR 2025)☆12May 15, 2025Updated last year
- [ACL'26 Findings] Steering LLM Thinking with Budget Guidance☆34Feb 19, 2026Updated 9 months ago
- Code for the paper "Function-Space Learning Rates"☆23Jun 3, 2025Updated last year
- A vim-like terminal reader to chat with your books☆40May 27, 2026Updated 5 months ago
Are these results useful?