lliai / Awesome-Low-Rank-AdaptationView external linksLinks
Awesome-Low-Rank-Adaptation
☆128Oct 13, 2024Updated last year
Alternatives and similar repositories for Awesome-Low-Rank-Adaptation
Users that are interested in Awesome-Low-Rank-Adaptation are comparing it to the libraries listed below
Sorting:
- ☆15Nov 7, 2024Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆172Jan 29, 2026Updated 2 weeks ago
- Awesome Low-Rank Adaptation☆59Aug 6, 2025Updated 6 months ago
- Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?☆119Oct 21, 2024Updated last year
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆232Dec 3, 2024Updated last year
- D^2-MoE: Delta Decompression for MoE-based LLMs Compression☆72Mar 25, 2025Updated 10 months ago
- [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models☆85Mar 5, 2024Updated last year
- ☆125Jul 6, 2024Updated last year
- ☆176Jul 22, 2024Updated last year
- CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for task-aware parameter-efficient fine-tuning(NeurIPS 2024)☆53Jan 13, 2025Updated last year
- This is a PyTorch implementation of "Cross-modality Discrepant Interaction Network for RGB-D Salient Object Detection" accepted by ACM MM…☆11Nov 22, 2021Updated 4 years ago
- A pytorch implementation of the ICCV2021 workshop paper SimDis: Simple Distillation Baselines for Improving Small Self-supervised Models☆14Jul 15, 2021Updated 4 years ago
- ☆12Apr 27, 2024Updated last year
- ☆255Aug 12, 2024Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆367Jun 1, 2023Updated 2 years ago
- ☆13Jan 8, 2020Updated 6 years ago
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆17Dec 17, 2025Updated 2 months ago
- Official project page for Estimating the Rate-Distortion Function by Wasserstein Gradient Descent☆19Nov 2, 2023Updated 2 years ago
- Auto-Prox-AAAI24☆14Apr 30, 2024Updated last year
- (ICML 2024) PyTorch implementation of "Self-Attention through Kernel-Eigen Pair Sparse Variational Gaussian Processes"☆16Oct 15, 2024Updated last year
- PyTorch distributed training comparison☆15Apr 11, 2021Updated 4 years ago
- KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation☆21Nov 3, 2024Updated last year
- QRHead: Query-Focused Retrieval Heads Improve Long-Context Reasoning and Re-ranking☆34Jan 20, 2026Updated 3 weeks ago
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,227Mar 10, 2024Updated last year
- ☆43Oct 1, 2024Updated last year
- Source code for the BMVC-2021 paper "SimReg: Regression as a Simple Yet Effective Tool for Self-supervised Knowledge Distillation".☆16Jan 20, 2022Updated 4 years ago
- PyTorch implementation for OD-cheap-convolution.☆20Sep 29, 2019Updated 6 years ago
- SHAKE☆18Apr 14, 2023Updated 2 years ago
- 😎 A curated list of tensor decomposition resources for model compression.☆105Jan 10, 2026Updated last month
- This repository contains code for the MicroAdam paper.☆22Dec 14, 2024Updated last year
- [ICML 2025] No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces (official repository)☆38Aug 7, 2025Updated 6 months ago
- [ICLR 2023] “ Layer Grafted Pre-training: Bridging Contrastive Learning And Masked Image Modeling For Better Representations”, Ziyu Jian…☆24Feb 16, 2023Updated 3 years ago
- [NeurIPS 2024] VeLoRA : Memory Efficient Training using Rank-1 Sub-Token Projections☆21Oct 15, 2024Updated last year
- ☆19Jan 3, 2025Updated last year
- ☆54Oct 29, 2024Updated last year
- ☆23Jun 13, 2024Updated last year
- The official implementation of the CVPR'2024 work Interference-Free Low-Rank Adaptation for Continual Learning☆103Mar 13, 2025Updated 11 months ago
- [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely☆24Jun 26, 2024Updated last year
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆20Oct 18, 2024Updated last year