Efficient non-uniform quantization with GPTQ for GGUF
☆67Sep 17, 2025Updated last year
Alternatives and similar repositories for gptq-gguf-toolkit
Users that are interested in gptq-gguf-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Jun 16, 2026Updated 4 months ago
- ☆46Jun 14, 2026Updated 4 months ago
- Gumbel-Softmax post-training quantization for LLMs (1–3 bit scalar, INT/GGUF-compatible).☆125Jul 11, 2026Updated 3 months ago
- Code for DASH, a faster alternative to Distributed Shampoo via block stacking.☆13Feb 18, 2026Updated 8 months ago
- A simple frontend page to interact with an OpenAI like API☆17Jan 31, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- RCO: Optimization of Non-Decomposable Objectives under Exact Budget Constraints for LLM Quantization and Pruning☆64Jun 13, 2026Updated 4 months ago
- ☆129Mar 18, 2026Updated 7 months ago
- ☆16Sep 27, 2023Updated 3 years ago
- Thin wrapper around GGML to make life easier☆48Jul 26, 2026Updated 3 months ago
- ☆127Feb 26, 2026Updated 8 months ago
- Fully chunked KL-Loss kernel, that massively reduces VRAM usage☆20Aug 10, 2026Updated 2 months ago
- Pytorch distributed backend extension with compression support☆17Mar 24, 2025Updated last year
- 📄Small Batch Size Training for Language Models☆89Mar 18, 2026Updated 7 months ago
- ☆97Jun 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆18Jul 1, 2025Updated last year
- Code for MatGPTQ: Efficient and Accurate Inference over Nested Quantized Models☆34Oct 6, 2026Updated 3 weeks ago
- ☆16Feb 6, 2024Updated 2 years ago
- ☆65Jul 10, 2025Updated last year
- Compute Where It Counts: Scaling both speed and quality with training compute☆13Sep 18, 2025Updated last year
- Code for data-aware compression of DeepSeek models☆75Dec 11, 2025Updated 10 months ago
- Work in progress.☆82Nov 25, 2025Updated 11 months ago
- Evalution: evolve your LLMs with better evals.☆16Sep 26, 2026Updated last month
- ☆197Jun 22, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆53May 20, 2025Updated last year
- (AAAI 2026) First-Order Error Matters: Accurate Compensation for Quantized Large Language Models☆17Apr 16, 2026Updated 6 months ago
- ☆18Jun 22, 2026Updated 4 months ago
- Quantized LLM training in pure CUDA/C++.☆266Aug 31, 2026Updated last month
- Disaggregated quantization official codebase☆32Oct 21, 2026Updated last week
- Self-contained Python lib with zero-dependencies that give you a unified device properties for gpu, cpu, and npu. No more calling separat…☆18Oct 18, 2026Updated last week
- QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning☆204Sep 2, 2026Updated last month
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Nov 3, 2023Updated 2 years ago
- Landing repository for the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"☆48May 13, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Efficient Knowledge Injection in LLMs via Self-Distillation (TMLR)☆12Aug 5, 2025Updated last year
- Official implementation for DenseMixer: Improving MoE Post-Training with Precise Router Gradient☆68Aug 3, 2025Updated last year
- Rust + Python implementation of the jzip spherical compression format for embeddings☆11Feb 21, 2026Updated 8 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆69Sep 10, 2024Updated 2 years ago
- A Pure JAX AsyncRL stack☆23Sep 7, 2026Updated last month
- ☆23Jun 12, 2025Updated last year
- ☆611Oct 29, 2024Updated 2 years ago