[NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
☆237Dec 3, 2024Updated last year
Alternatives and similar repositories for HydraLoRA
Users that are interested in HydraLoRA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆403Apr 29, 2024Updated last year
- ☆125Jul 6, 2024Updated last year
- Awesome-Low-Rank-Adaptation☆127Oct 13, 2024Updated last year
- Latest Advances on Federated LLM Learning☆109Jul 7, 2025Updated 9 months ago
- Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision☆11Jul 22, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆203Aug 22, 2024Updated last year
- The implementation for FREE-Merging: Fourier Transform for Model Merging with Lightweight Experts (ICCV25)☆14Jun 26, 2025Updated 9 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆179Jan 29, 2026Updated 2 months ago
- ☆115Jan 2, 2025Updated last year
- Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]☆62Apr 17, 2025Updated 11 months ago
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆43Oct 15, 2024Updated last year
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆148Apr 8, 2025Updated last year
- [ICLR'25] Code for KaSA, an official implementation of "KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models"☆20Jan 16, 2025Updated last year
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆419Jun 30, 2025Updated 9 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆958Mar 24, 2026Updated 3 weeks ago
- ☆13Jun 26, 2024Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆374Jun 1, 2023Updated 2 years ago
- ☆275Oct 31, 2023Updated 2 years ago
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆32Feb 18, 2026Updated last month
- ☆221Nov 25, 2025Updated 4 months ago
- ☆12Jul 30, 2025Updated 8 months ago
- ☆123Mar 29, 2026Updated 2 weeks ago
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆69Aug 22, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This is the official code repository for the paper: Towards General Continuous Memory for Vision-Language Models.☆24Jul 3, 2025Updated 9 months ago
- The code repository for "Multi-layer Rehearsal Feature Augmentation for Class-Incremental Learning" (ICML24)☆11Jun 7, 2024Updated last year
- ☆32Dec 17, 2025Updated 3 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆39Feb 27, 2024Updated 2 years ago
- [NeurIPS 2025] Think Silently, Think Fast: Dynamic Latent Compression of LLM Reasoning Chains☆89Mar 27, 2026Updated 2 weeks ago
- MCITlib: Multimodal Continual Instruction Tuning Library and Benchmark☆76Apr 9, 2026Updated last week
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆80Mar 1, 2025Updated last year
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Apr 4, 2024Updated 2 years ago
- [ ICLR 2025 ] Making LLMs More Effective with Hierarchical Mixture of LoRA Experts☆29Oct 9, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code for Research Project TLDR☆25Jul 28, 2025Updated 8 months ago
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated last year
- [ECCV 2024] Online Continuous Generalized Category Discovery☆14Oct 6, 2024Updated last year
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆33Aug 18, 2023Updated 2 years ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆12Jul 22, 2024Updated last year
- Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity☆22Aug 28, 2025Updated 7 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆192Jul 22, 2024Updated last year