Pytorch code for paper QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
β25Sep 27, 2023Updated 2 years ago
Alternatives and similar repositories for qa-lora
Users that are interested in qa-lora are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. π The official implementation of https://arxβ¦β31Feb 17, 2025Updated last year
- Official repo for EMNLP 2023 paper "Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanationsβ¦β29Dec 5, 2023Updated 2 years ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Modelsβ35Jun 12, 2024Updated 2 years ago
- Streamlines the creation of dataset to train a Large Language Model with triplets : instruction-input-output . The default configuration β¦β13Apr 17, 2023Updated 3 years ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retentiβ¦β65Apr 15, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- β54Nov 5, 2024Updated last year
- Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Modelsβ49Nov 5, 2024Updated last year
- β15Apr 11, 2024Updated 2 years ago
- β20Dec 5, 2024Updated last year
- [ASPLOS 2026] M2XFP: A Metadata-Augmented Microscaling Data Format for Efficient Low-bit Quantization.β15Jan 29, 2026Updated 5 months ago
- [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"β39Aug 20, 2024Updated last year
- β15Sep 24, 2023Updated 2 years ago
- ViTALiTy (HPCA'23) Code Repositoryβ23Mar 13, 2023Updated 3 years ago
- β17Apr 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- β16Apr 11, 2024Updated 2 years ago
- [NeurIPS 2025] Speculate Deep and Accurateβ21Jan 16, 2026Updated 6 months ago
- β42Mar 28, 2024Updated 2 years ago
- Fork of Flame repo for training of some new stuff in developmentβ20Jul 15, 2026Updated last week
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQβ101May 30, 2023Updated 3 years ago
- β25Oct 31, 2024Updated last year
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both sameβ¦β63Mar 21, 2026Updated 4 months ago
- AFPQ code implementationβ23Nov 6, 2023Updated 2 years ago
- [EMNLP 2025] AMQ: Enabling AutoML for Mixed-precision Weight-Only Quantization of Large Language Modelsβ16Apr 29, 2026Updated 2 months ago
- Proton VPN Special Offer - Get 70% off β’ AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- β234Jun 11, 2024Updated 2 years ago
- AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inferenceβ21Jan 24, 2025Updated last year
- β54Jul 18, 2024Updated 2 years ago
- Utilities for efficient fine-tuning, inference and evaluation of code generation modelsβ21Oct 3, 2023Updated 2 years ago
- [ICCV 2025] Official code for "AIM: Adaptive Inference of Multi-Modal LLMs via Token Merging and Pruning"β65Oct 9, 2025Updated 9 months ago
- β17Jun 18, 2024Updated 2 years ago
- μΈμ΄μ μ»΄ν¨ν° (2021νλ λ 2νκΈ°, μμΈλνκ΅ μΈμ΄νκ³Ό)β13Aug 16, 2022Updated 3 years ago
- [UNDER CONSTRUCTION]unofficial implementation of ABC-Netβ12Feb 5, 2018Updated 8 years ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Modelβ¦β72Mar 7, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.β158Aug 21, 2025Updated 11 months ago
- β25Dec 11, 2021Updated 4 years ago
- ACL 2023β39Jun 6, 2023Updated 3 years ago
- Code repository for ACL-IJCNLP 2021 paper 'Poisoning Knowledge Graph Embeddings via Relation Inference Patterns'β14Oct 13, 2022Updated 3 years ago
- β30Jul 22, 2024Updated 2 years ago
- β16Aug 3, 2020Updated 5 years ago
- [COLM 2024] SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Modelsβ24Oct 5, 2024Updated last year