EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
☆367Updated last week
Alternatives and similar repositories for Awesome-Model-Merging-Methods-Theories-Applications:
Users that are interested in Awesome-Model-Merging-Methods-Theories-Applications are comparing it to the libraries listed below
- ☆174Updated last year
- A curated list of Model Merging methods.☆91Updated 7 months ago
- Continual Learning of Large Language Models: A Comprehensive Survey☆390Updated 2 weeks ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆223Updated last month
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆77Updated 5 months ago
- LLM hallucination paper list☆314Updated last year
- A Survey on Efficient Reasoning for LLMs☆332Updated this week
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆188Updated 4 months ago
- ☆132Updated 9 months ago
- Paper list for Efficient Reasoning.☆403Updated this week
- Must-read Papers on Large Language Model (LLM) Continual Learning☆141Updated last year
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆347Updated 2 months ago
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆319Updated last year
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆321Updated 11 months ago
- A Survey on Data Selection for Language Models☆225Updated 6 months ago
- ☆90Updated 3 months ago
- Awesome list for LLM pruning.☆222Updated 4 months ago
- ☆255Updated last year
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆407Updated last year
- Paper List of Inference/Test Time Scaling/Computing☆195Updated this week
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆133Updated last month
- This paper list focuses on the theoretical and empirical analysis of language models, especially large language models (LLMs). The papers…☆80Updated 4 months ago
- FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion☆121Updated this week
- ☆113Updated 7 months ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆156Updated last year
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆481Updated 3 months ago
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆190Updated last week
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆435Updated 6 months ago
- Function Vectors in Large Language Models (ICLR 2024)☆161Updated last week
- ☆172Updated 9 months ago