Pytorch code for paper QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
β25Sep 27, 2023Updated 3 years ago
Alternatives and similar repositories for qa-lora
Users that are interested in qa-lora are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. π The official implementation of https://arxβ¦β32Feb 17, 2025Updated last year
- Official PyTorch implementation of QA-LoRAβ149Mar 13, 2024Updated 2 years ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retentiβ¦β65Sep 11, 2026Updated last month
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both sameβ¦β65Mar 21, 2026Updated 7 months ago
- β56Nov 5, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ASPLOS 2026] M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization.β17Jan 29, 2026Updated 9 months ago
- Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Modelsβ49Nov 5, 2024Updated last year
- β54Jul 18, 2024Updated 2 years ago
- Streamlines the creation of dataset to train a Large Language Model with triplets : instruction-input-output . The default configuration β¦β13Apr 17, 2023Updated 3 years ago
- β15Apr 11, 2024Updated 2 years ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"β39Aug 20, 2024Updated 2 years ago
- Code for SFT and RLβ12Jun 22, 2025Updated last year
- Artifact for Oaken: Fast and Efficient LLM Serving with Online-Offline Hybrid KV Cache Quantizationβ20May 9, 2025Updated last year
- β16Apr 11, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- β15Sep 24, 2023Updated 3 years ago
- β18Apr 7, 2025Updated last year
- β42Mar 28, 2024Updated 2 years ago
- β21Dec 5, 2024Updated last year
- ViTALiTy (HPCA'23) Code Repositoryβ25Mar 13, 2023Updated 3 years ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Modelsβ35Jun 12, 2024Updated 2 years ago
- [NeurIPS 2025] Speculate Deep and Accurateβ25Aug 10, 2026Updated 2 months ago
- Pytorch implementation of BiFSMNv2, TNNLS 2023β37Sep 11, 2026Updated last month
- β12Oct 5, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.β141May 16, 2024Updated 2 years ago
- AFPQ code implementationβ23Nov 6, 2023Updated 2 years ago
- β236Jun 11, 2024Updated 2 years ago
- β47Aug 29, 2024Updated 2 years ago
- β26Oct 31, 2024Updated 2 years ago
- Disaggregated quantization official codebaseβ32Oct 21, 2026Updated last week
- ACL 2023β38Jun 6, 2023Updated 3 years ago
- AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inferenceβ21Jan 24, 2025Updated last year
- The official repository of Quamba1 [ICLR 2025] & Quamba2 [ICML 2025]β70Jun 19, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β25Dec 11, 2021Updated 4 years ago
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformerβ31Dec 6, 2023Updated 2 years ago
- β30Jul 22, 2024Updated 2 years ago
- [COLM 2025] DFRot: Achieving Outlier-Free and Massive Activation-Free for Rotated LLMs with Refined Rotation; η₯δΉοΌhttps://zhuanlan.zhihu.cβ¦β30Mar 5, 2025Updated last year
- LLM Inference with Microscaling Formatβ35Nov 12, 2024Updated last year
- β129Mar 18, 2026Updated 7 months ago
- Code repository for ACL-IJCNLP 2021 paper 'Poisoning Knowledge Graph Embeddings via Relation Inference Patterns'β14Oct 13, 2022Updated 4 years ago