Alternatives and similar repositories for CPT

Users that are interested in CPT are comparing it to the libraries listed below

• UIC-Liu-Lab / DGA
  [EMNLP 2022] Adapting a Language Model While Preserving its General Knowledge
  ☆21Updated 2 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆69Updated last year
• McGill-NLP / polytropon
  ☆53Updated 2 years ago
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆45Updated 2 years ago
• thunlp / ELLE
  ☆32Updated 3 years ago
• arazd / ProgressivePrompts
  Progressive Prompts: Continual Learning for Language Models
  ☆93Updated 2 years ago
• jiacheng-ye / ZeroGen
  [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.
  ☆48Updated 3 years ago
• llyx97 / Rosita
  [AAAI 2021] "ROSITA: Refined BERT cOmpreSsion with InTegrAted techniques", Yuanxin Liu, Zheng Lin, Fengcheng Yuan
  ☆14Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆50Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• yumeng5 / SuperGen
  [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
  ☆65Updated 2 years ago
• yiren-jian / NonLing-CSE
  [NeurIPS 2022] Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings
  ☆21Updated 2 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆109Updated last year
• Zce1112zslx / IKE
  ☆41Updated last year
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• OhadRubin / EPR
  ☆61Updated 2 years ago
• SALT-NLP / Adaptive-Compositional-Modules
  Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"
  ☆38Updated 3 years ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 8 months ago
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• KaiLv69 / UDR
  ACL'23: Unified Demonstration Retriever for In-Context Learning
  ☆37Updated last year
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆71Updated 2 years ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated last year
• adymaharana / d2pruning
  ☆35Updated last year
• SumilerGAO / SunGen
  ☆26Updated 2 years ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year