zzz47zzz / awesome-lifelong-learning-methods-for-llm

Related projects ⓘ

Alternatives and complementary repositories for awesome-lifelong-learning-methods-for-llm

• qianlima-lab / awesome-lifelong-learning-methods-for-llm
  This repository collects awesome survey, resource, and paper for Lifelong Learning for Large Language Models. (Updated Regularly)
  ☆31Updated 2 weeks ago
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆59Updated 9 months ago
• GCYZSL / MoLA
  ☆116Updated 3 months ago
• zzz47zzz / codebase-for-incremental-learning-with-llm
  [ACL2024] A Codebase for Incremental Learning with Large Language Models; Official released code for "Learn or Recall? Revisiting Increme…
  ☆20Updated last month
• sail-sg / sdft
  [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".
  ☆100Updated 2 weeks ago
• cmnfriend / O-LoRA
  ☆147Updated 4 months ago
• which47 / LLMCL
  Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  ☆22Updated this week
• liuqidong07 / MOELoRA-peft
  [SIGIR'24] The official implementation code of MOELoRA.
  ☆124Updated 3 months ago
• Wang-ML-Lab / llm-continual-learning-survey
  Continual Learning of Large Language Models: A Comprehensive Survey
  ☆252Updated last week
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆92Updated 2 months ago
• AGI-Edgerunners / LLM-Continual-Learning-Papers
  Must-read Papers on Large Language Model (LLM) Continual Learning
  ☆134Updated last year
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆63Updated last year
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆23Updated last month
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆94Updated 7 months ago
• adymaharana / d2pruning
  ☆31Updated last year
• junkangwu / beta-DPO
  [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
  ☆29Updated 3 weeks ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆58Updated 2 years ago
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆97Updated 7 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆46Updated last month
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆36Updated this week
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆45Updated 7 months ago
• waltonfuture / Diff-eRank
  Code for https://arxiv.org/abs/2401.17139 (NeurIPS 2024)
  ☆25Updated this week
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆33Updated 10 months ago
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆44Updated this week
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆53Updated 3 weeks ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆35Updated 7 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆25Updated 4 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆15Updated 6 months ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆58Updated 11 months ago
• Open-Source-O1 / o1_Reasoning_Patterns_Study
  ☆62Updated 3 weeks ago