Alternatives and similar repositories for CPT:

Users that are interested in CPT are comparing it to the libraries listed below

• UIC-Liu-Lab / DGA
  [EMNLP 2022] Adapting a Language Model While Preserving its General Knowledge
  ☆21Updated 2 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆32Updated 2 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆69Updated last year
• SumilerGAO / SunGen
  ☆25Updated last year
• McGill-NLP / polytropon
  ☆52Updated last year
• jiacheng-ye / ZeroGen
  [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.
  ☆46Updated 3 years ago
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆64Updated last year
• thunlp / ELLE
  ☆32Updated 2 years ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated 9 months ago
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• SALT-NLP / Adaptive-Compositional-Modules
  Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"
  ☆38Updated 2 years ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆38Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆55Updated 7 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆27Updated 11 months ago
• Zce1112zslx / IKE
  ☆40Updated last year
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆44Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• chujiezheng / LLM-MCQ-Bias
  Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"
  ☆38Updated 8 months ago
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆22Updated 6 months ago
• arazd / ResidualPrompts
  Residual Prompt Tuning: a method for faster and better prompt tuning.
  ☆52Updated last year
• swj0419 / in-context-pretraining
  ☆47Updated 10 months ago
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆58Updated 3 months ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆43Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆66Updated 2 years ago
• SALT-NLP / IDBR
  Codes for the paper: "Continual Learning for Text Classification with Information Disentanglement Based Regularization"
  ☆44Updated 2 years ago