Awesome-Low-Rank-Adaptation
☆128Oct 13, 2024Updated last year
Alternatives and similar repositories for Awesome-Low-Rank-Adaptation
Users that are interested in Awesome-Low-Rank-Adaptation are comparing it to the libraries listed below
Sorting:
- ☆15Nov 7, 2024Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆176Jan 29, 2026Updated last month
- Awesome Low-Rank Adaptation☆59Aug 6, 2025Updated 7 months ago
- [ICLR'25] Code for KaSA, an official implementation of "KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models"☆20Jan 16, 2025Updated last year
- Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?☆118Oct 21, 2024Updated last year
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆232Dec 3, 2024Updated last year
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆73Mar 25, 2025Updated 11 months ago
- ☆126Jul 6, 2024Updated last year
- ☆177Jul 22, 2024Updated last year
- ☆17May 2, 2024Updated last year
- [ICML2024] DetKDS: Knowledge Distillation Search for Object Detectors☆19Jul 11, 2024Updated last year
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆55Jan 13, 2025Updated last year
- This is a PyTorch implementation of "Cross-modality Discrepant Interaction Network for RGB-D Salient Object Detection" accepted by ACM MM…☆11Nov 22, 2021Updated 4 years ago
- ☆12Apr 27, 2024Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆370Jun 1, 2023Updated 2 years ago
- ☆19Nov 16, 2023Updated 2 years ago
- ☆13Jan 8, 2020Updated 6 years ago
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆17Dec 17, 2025Updated 2 months ago
- (ICML 2024) PyTorch implementation of "Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes"☆16Oct 15, 2024Updated last year
- Auto-Prox-AAAI24☆14Apr 30, 2024Updated last year
- [ICML 2021] "Auto-NBA: Efficient and Effective Search Over the Joint Space of Networks, Bitwidths, and Accelerators" by Yonggan Fu, Yonga…☆16Jan 3, 2022Updated 4 years ago
- Official project page for Estimating the Rate-Distortion Function by Wasserstein Gradient Descent☆19Nov 2, 2023Updated 2 years ago
- PyTorch distributed training comparison☆15Apr 11, 2021Updated 4 years ago
- KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation☆22Nov 3, 2024Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,229Mar 10, 2024Updated last year
- ☆42Oct 1, 2024Updated last year
- SHAKE☆18Apr 14, 2023Updated 2 years ago
- Source code for the BMVC-2021 paper "SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation".☆16Jan 20, 2022Updated 4 years ago
- PyTorch implementation for OD-cheap-convolution.☆20Sep 29, 2019Updated 6 years ago
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆21Oct 15, 2024Updated last year
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Feb 16, 2023Updated 3 years ago
- Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"☆21Jun 11, 2025Updated 8 months ago
- ☆21Dec 5, 2021Updated 4 years ago
- ☆54Oct 29, 2024Updated last year
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆24Jun 26, 2024Updated last year
- ☆23Aug 28, 2023Updated 2 years ago
- The official implementation of the CVPR'2024 work Interference-Free Low-Rank Adaptation for Continual Learning☆108Mar 13, 2025Updated 11 months ago
- [ICLR 2022] Training L_inf-dist-net with faster acceleration and better training strategies☆22Mar 16, 2022Updated 3 years ago