Clin0212 / HydraLoRAView external linksLinks
[NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
☆232Dec 3, 2024Updated last year
Alternatives and similar repositories for HydraLoRA
Users that are interested in HydraLoRA are comparing it to the libraries listed below
Sorting:
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆400Apr 29, 2024Updated last year
- ☆125Jul 6, 2024Updated last year
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆203Aug 22, 2024Updated last year
- ☆13Jun 26, 2024Updated last year
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆171Jan 29, 2026Updated 2 weeks ago
- Awesome-Low-Rank-Adaptation☆128Oct 13, 2024Updated last year
- This repo contains the source code for VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks (NeurIPS 2024).☆42Oct 15, 2024Updated last year
- Latest Advances on Federated LLM Learning☆97Jul 7, 2025Updated 7 months ago
- ☆110Jan 2, 2025Updated last year
- Selective Aggregation for Low-Rank Adaptation in Federated Learning [ICLR 2025]☆58Apr 17, 2025Updated 9 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆143Apr 8, 2025Updated 10 months ago
- Adapter-X: A Novel General Parameter-Efficient Fine-Tuning Framework for Vision☆11Jul 22, 2024Updated last year
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆931Oct 1, 2024Updated last year
- [ICRA 2024] Official PyTorch Implementation of ''Human Observation-Inspired Trajectory Prediction for Autonomous Driving in Mixed-Autonom…☆12Feb 29, 2024Updated last year
- AdaMoLE: Adaptive Mixture of LoRA Experts☆38Oct 11, 2024Updated last year
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆36Apr 4, 2024Updated last year
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆366Jun 1, 2023Updated 2 years ago
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆409Jun 30, 2025Updated 7 months ago
- ☆20Oct 13, 2024Updated last year
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆13Jul 22, 2024Updated last year
- RecConv: Efficient Recursive Convolutions for Multi-Frequency Representations☆19Oct 13, 2025Updated 4 months ago
- [ICLR'25] Code for KaSA, an official implementation of "KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models"☆20Jan 16, 2025Updated last year
- ☆273Oct 31, 2023Updated 2 years ago
- ☆32Dec 17, 2025Updated last month
- FFNet: MetaMixer-based Efficient Convolutional Mixer Design☆31Mar 11, 2025Updated 11 months ago
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆34Aug 18, 2023Updated 2 years ago
- ☆37Oct 17, 2025Updated 3 months ago
- ☆218Nov 25, 2025Updated 2 months ago
- [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization☆37Sep 24, 2024Updated last year
- [ ICLR 2025 ] Making LLMs More Effective with Hierarchical Mixture of LoRA Experts☆27Oct 9, 2025Updated 4 months ago
- ☆49Mar 14, 2025Updated 11 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆76Mar 1, 2025Updated 11 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆38Feb 27, 2024Updated last year
- ☆43Jul 22, 2024Updated last year
- ActMAD: Activation Matching to Align Distributions for Test-Time-Training (CVPR 2023)☆21Jun 27, 2023Updated 2 years ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆29Jul 24, 2025Updated 6 months ago
- pFedDef: Defending Grey-Box Attacks for Personalized Federated Learning☆10May 31, 2023Updated 2 years ago
- Code for ICML 2025: SAH-Drive: A Scenario-Aware Hybrid Planner for Closed-Loop Vehicle Trajectory Generation☆17Jun 21, 2025Updated 7 months ago
- Entropy-Driven GRPO with Guided Error Correction for Advantage Diversity☆22Aug 28, 2025Updated 5 months ago