Pytorch code for paper QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
β25Sep 27, 2023Updated 2 years ago
Alternatives and similar repositories for qa-lora
Users that are interested in qa-lora are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. π The official implementation of https://arxβ¦β31Feb 17, 2025Updated last year
- Official repo for EMNLP 2023 paper "Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanationsβ¦β29Dec 5, 2023Updated 2 years ago
- Official PyTorch implementation of QA-LoRAβ147Mar 13, 2024Updated 2 years ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Modelsβ35Jun 12, 2024Updated 2 years ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retentiβ¦β65Apr 15, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β54Nov 5, 2024Updated last year
- Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Modelsβ49Nov 5, 2024Updated last year
- β15Apr 11, 2024Updated 2 years ago
- β20Dec 5, 2024Updated last year
- [ASPLOS 2026] M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization.β16Jan 29, 2026Updated 6 months ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"β39Aug 20, 2024Updated last year
- β15Sep 24, 2023Updated 2 years ago
- ViTALiTy (HPCA'23) Code Repositoryβ23Mar 13, 2023Updated 3 years ago
- β17Apr 7, 2025Updated last year
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- β16Apr 11, 2024Updated 2 years ago
- [NeurIPS 2025] Speculate Deep and Accurateβ23Updated this week
- Pytorch implementation of BiFSMNv2, TNNLS 2023β37Feb 10, 2023Updated 3 years ago
- β42Mar 28, 2024Updated 2 years ago
- Fork of Flame repo for training of some new stuff in developmentβ20Updated this week
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQβ101May 30, 2023Updated 3 years ago
- β25Oct 31, 2024Updated last year
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both sameβ¦β64Mar 21, 2026Updated 4 months ago
- AFPQ code implementationβ23Nov 6, 2023Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer β’ AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- [EMNLP 2025] AMQ: Enabling AutoML for Mixed-precision Weight-Only Quantization of Large Language Modelsβ16Apr 29, 2026Updated 3 months ago
- β234Jun 11, 2024Updated 2 years ago
- AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inferenceβ21Jan 24, 2025Updated last year
- Official code, models, and dataset for "Evolution Fine-Tuning (EFT): Learning to Discover Across 371 Optimization Tasks"β28Jun 30, 2026Updated last month
- An installer tool for petals decentralized text generation networkβ12Oct 1, 2023Updated 2 years ago
- β54Jul 18, 2024Updated 2 years ago
- [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"β65Oct 9, 2025Updated 10 months ago
- β17Jun 18, 2024Updated 2 years ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Modelβ¦β72Mar 7, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [UNDER CONSTRUCTION]unofficial implementation of ABC-Netβ12Feb 5, 2018Updated 8 years ago
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.β160Aug 21, 2025Updated 11 months ago
- β25Dec 11, 2021Updated 4 years ago
- ACL 2023β39Jun 6, 2023Updated 3 years ago
- β30Jul 22, 2024Updated 2 years ago
- Code repository for ACL-IJCNLP 2021 paper 'Poisoning Knowledge Graph Embeddings via Relation Inference Patterns'β14Oct 13, 2022Updated 3 years ago
- 1990β2021λ νκ΅μ΄ μ λ¬Έ μ¬νλ©΄ κΈ°μ¬μ ββε₯³Β·ββη· μ§κ³β17Sep 26, 2023Updated 2 years ago