EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
☆342Updated this week
Alternatives and similar repositories for Awesome-Model-Merging-Methods-Theories-Applications:
Users that are interested in Awesome-Model-Merging-Methods-Theories-Applications are comparing it to the libraries listed below
- Continual Learning of Large Language Models: A Comprehensive Survey☆370Updated 3 weeks ago
- ☆169Updated last year
- A curated list of Model Merging methods.☆91Updated 6 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆70Updated 4 months ago
- A Survey on Data Selection for Language Models☆218Updated 5 months ago
- ☆127Updated 8 months ago
- A curated list of LLM Interpretability related material - Tutorial, Library, Survey, Paper, Blog, etc..☆208Updated this week
- Must-read Papers on Large Language Model (LLM) Continual Learning☆141Updated last year
- [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning☆175Updated 3 months ago
- [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning☆421Updated 5 months ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆149Updated 7 months ago
- ☆170Updated 8 months ago
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)☆334Updated last month
- Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.☆405Updated 11 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆306Updated 10 months ago
- ☆268Updated 3 weeks ago
- Paper List of Inference/Test Time Scaling/Computing☆127Updated this week
- The official GitHub page for the survey paper "A Survey on Mixture of Experts in Large Language Models".☆303Updated last week
- AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).☆305Updated last year
- LLM hallucination paper list☆310Updated last year
- ☆486Updated 3 weeks ago
- Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"☆475Updated 2 months ago
- FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion☆117Updated last week
- Official PyTorch implementation of DistiLLM: Towards Streamlined Distillation for Large Language Models (ICML 2024)☆201Updated last week
- ☆253Updated last year
- Function Vectors in Large Language Models (ICLR 2024)☆149Updated last week
- Awesome list for LLM pruning.☆212Updated 3 months ago
- ☆182Updated 5 months ago
- Paper list for Efficient Reasoning.☆311Updated this week
- Code accompanying the paper "Massive Activations in Large Language Models"☆150Updated last year