[NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
☆239Dec 3, 2024Updated last year
Alternatives and similar repositories for HydraLoRA
Users that are interested in HydraLoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆405Apr 29, 2024Updated 2 years ago
- ☆126Jul 6, 2024Updated 2 years ago
- [ICLR'25] Code for KaSA, an official implementation of "KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models"☆22Jan 16, 2025Updated last year
- Awesome-Low-Rank-Adaptation☆133Oct 13, 2024Updated last year
- The implementation for FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts (ICCV25)☆16Jun 26, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision☆11Jul 22, 2024Updated 2 years ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆182Jan 29, 2026Updated 5 months ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆208Aug 22, 2024Updated last year
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆43Oct 15, 2024Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆150Apr 8, 2025Updated last year
- ☆17Apr 29, 2025Updated last year
- ☆13Jun 26, 2024Updated 2 years ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆394Jun 1, 2023Updated 3 years ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆985Mar 24, 2026Updated 4 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆429Jun 30, 2025Updated last year
- ☆278Oct 31, 2023Updated 2 years ago
- ☆120Jan 2, 2025Updated last year
- ☆219Nov 25, 2025Updated 8 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆83Mar 1, 2025Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆38Jun 20, 2024Updated 2 years ago
- ☆12Jul 30, 2025Updated 11 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆40Feb 27, 2024Updated 2 years ago
- ☆32Dec 17, 2025Updated 7 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆72Aug 22, 2023Updated 2 years ago
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆32Feb 18, 2026Updated 5 months ago
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆38Apr 4, 2024Updated 2 years ago
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆94Apr 3, 2025Updated last year
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆34Feb 19, 2025Updated last year
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆35Aug 18, 2023Updated 2 years ago
- RecConv: Efficient Recursive Convolutions for Multi-Frequency Representations☆19Oct 13, 2025Updated 9 months ago
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated last year
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆12Jul 22, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [SIGIR'24] The official implementation code of MOELoRA.☆193Jul 22, 2024Updated 2 years ago
- Code for Research Project TLDR☆26Jul 28, 2025Updated 11 months ago
- ☆210Jul 13, 2024Updated 2 years ago
- ☆10Apr 16, 2024Updated 2 years ago
- ☆45Jul 22, 2024Updated 2 years ago
- CoLeCLIP: Open-Domain Continual Learning via Joint Task Prompt and Vocabulary Learning☆17Mar 21, 2024Updated 2 years ago
- ☆28Jul 17, 2026Updated last week