[CSUR 2025] Continual Learning of Large Language Models: A Comprehensive Survey
☆551Dec 23, 2025Updated 5 months ago
Alternatives and similar repositories for llm-continual-learning-survey
Users that are interested in llm-continual-learning-survey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆99Jan 24, 2024Updated 2 years ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆150Nov 14, 2023Updated 2 years ago
- [ACM Computing Surveys 2025] This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Model…☆164May 30, 2025Updated last year
- A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning. TPAMI, 2024.☆363Jan 27, 2026Updated 4 months ago
- This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)☆72May 30, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An Extensible Continual Learning Framework Focused on Language Models (LMs)☆290Jan 28, 2024Updated 2 years ago
- [ACL2024] A Codebase for Incremental Learning with Large Language Models; Official released code for "Learn or Recall? Revisiting Increme…☆62Feb 1, 2025Updated last year
- [NeurIPS 2023] A Unified Approach to Domain Incremental Learning with Memory: Theory and Algorithm☆54Jan 26, 2025Updated last year
- Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".☆17Dec 15, 2021Updated 4 years ago
- Bayesian Low-Rank Adaptation of LLMs: BLoB [NeurIPS 2024] and TFB [NeurIPS 2025]☆38Feb 4, 2026Updated 4 months ago
- 🎉 PILOT: A Pre-trained Model-Based Continual Learning Toolbox☆585Jan 29, 2026Updated 4 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆40Jan 13, 2025Updated last year
- ☆206Jul 13, 2024Updated last year
- ☆29Apr 7, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- SLCA: Slow Learner with Classifier Alignment for Continual Learning on a Pre-trained Model @ ICCV 2023 **AND** SLCA++: Unleash the Power …☆54Aug 17, 2024Updated last year
- "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)☆15Jul 24, 2023Updated 2 years ago
- ☆158Mar 27, 2026Updated 2 months ago
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆55Apr 22, 2026Updated last month
- Adding new tasks to T0 without catastrophic forgetting☆33Oct 20, 2022Updated 3 years ago
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆60May 22, 2024Updated 2 years ago
- Awesome Incremental Learning☆4,481Updated this week
- The reproduce of paper "Continual Vision-Language Representation Learning with Off-Diagonal Information ".(Mod-X)☆12Oct 31, 2023Updated 2 years ago
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)☆1,003Dec 6, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Must-read Papers on Knowledge Editing for Large Language Models.☆1,231Jul 12, 2025Updated 11 months ago
- Code for paper "MoE-Adapters" CVPR2024 and "MoE-Adapters++" TPAMI2025☆274Sep 18, 2025Updated 9 months ago
- VQACL: A Novel Visual Question Answering Continual Learning Setting (CVPR'23)☆45Mar 28, 2024Updated 2 years ago
- Instruction Tuning in Continual Learning paradigm☆80Feb 5, 2025Updated last year
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. ACM Computing Surveys, 2026.☆754Updated this week
- [EMNLP 2024 Findings] Unlocking Continual Learning Abilities in Language Models☆26Oct 8, 2024Updated last year
- An Incremental Learning, Continual Learning, and Life-Long Learning Repository☆608May 11, 2024Updated 2 years ago
- PyContinual (An Easy and Extendible Framework for Continual Learning)☆324Jan 29, 2024Updated 2 years ago
- [ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.☆2,846Jun 11, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ICLR 2023 (Spotlight)] Domain-Indexing Variational Bayes: Interpretable Domain Index for Domain Adaptation☆41Jan 13, 2024Updated 2 years ago
- PyTorch implementation of various methods for continual learning (XdG, EWC, SI, LwF, FROMP, DGR, BI-R, ER, A-GEM, iCaRL, Generative Class…☆1,865Nov 5, 2025Updated 7 months ago
- Bayesian low-rank adaptation for large language models☆29May 4, 2024Updated 2 years ago
- ☆16Nov 12, 2024Updated last year
- A Comprehensive Survey on Continual Learning in Generative Models.☆157Jun 1, 2026Updated 2 weeks ago
- Hierarchical Decomposition of Prompt-Based Continual Learning: Rethinking Obscured Sub-optimality (NeurIPS 2023, Spotlight)☆92Nov 15, 2024Updated last year
- ☆33Feb 24, 2025Updated last year