zzz47zzz / awesome-lifelong-learning-methods-for-llm
This repository collects awesome survey, resource, and paper for Lifelong Learning with Large Language Models. (Updated Regularly)
☆15Updated 3 weeks ago
Related projects: ⓘ
- ☆25Updated 11 months ago
- This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)☆22Updated 3 weeks ago
- Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning☆19Updated last month
- [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"☆90Updated 5 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆19Updated last month
- On the Effectiveness of Parameter-Efficient Fine-Tuning☆38Updated 10 months ago
- Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022☆58Updated 2 years ago
- MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)☆28Updated 5 months ago
- [ACL 2023] Code for paper “Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation”(https://arxiv.org/abs/2305.…☆38Updated last year
- Code for paper: “What Data Benefits My Classifier?” Enhancing Model Performance and Interpretability through Influence-Based Data Selecti…☆23Updated 4 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆81Updated this week
- The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.☆62Updated 6 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆40Updated 2 weeks ago
- A repository of useful research/skill-upgrading talks or acticles in NLP/CV/AI Area (in Chinese).☆65Updated last month
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆56Updated 7 months ago
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆60Updated 3 weeks ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆129Updated 10 months ago
- ☆42Updated 5 months ago
- An Easy-to-use Hallucination Detection Framework for LLMs.☆48Updated 5 months ago
- ☆22Updated 9 months ago
- ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse☆49Updated last year
- [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"☆34Updated 4 months ago
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆23Updated 3 months ago
- AutoPEFT: Automatic Configuration Search for Parameter-Efficient Fine-Tuning (Zhou et al.; TACL)☆42Updated 6 months ago
- ☆31Updated 3 months ago
- [ACL2024] A Codebase for Incremental Learning with Large Language Models; Official released code for "Learn or Recall? Revisiting Increme…☆13Updated 2 months ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆12Updated 4 months ago
- Representation Surgery for Multi-Task Model Merging. ICML, 2024.☆23Updated 3 weeks ago
- ☆27Updated 3 months ago
- ☆113Updated last year