ruz048 / AutoLoRA
☆10Updated 10 months ago
Alternatives and similar repositories for AutoLoRA:
Users that are interested in AutoLoRA are comparing it to the libraries listed below
- ☆125Updated 7 months ago
- An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT☆73Updated last month
- 📜 Paper list on decoding methods for LLMs and LVLMs☆26Updated 2 months ago
- Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]☆40Updated 4 months ago
- awesome SAE papers☆18Updated last week
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆105Updated 11 months ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆134Updated 6 months ago
- ☆50Updated last year
- ☆14Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.☆147Updated 7 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆67Updated 4 months ago
- Awesome Low-Rank Adaptation☆29Updated 5 months ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆45Updated this week
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆31Updated last month
- A block pruning framework for LLMs.☆19Updated 8 months ago
- The repo for In-context Autoencoder☆110Updated 9 months ago
- [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging☆50Updated 3 months ago
- Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…☆67Updated this week
- ☆17Updated 3 months ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆39Updated 3 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆17Updated last week
- ☆12Updated 10 months ago
- In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)☆50Updated 11 months ago
- ☆73Updated 2 months ago
- This is the official code for the paper "Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning" (NeurIPS2024)☆17Updated 5 months ago
- [ICML 2024] Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications☆71Updated this week
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆23Updated last month
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆60Updated last year