Alternatives and similar repositories for CPT

Users that are interested in CPT are comparing it to the libraries listed below

• UIC-Liu-Lab / DGA
  [EMNLP 2022] Adapting a Language Model While Preserving its General Knowledge
  ☆21Updated 2 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆102Updated 2 years ago
• thunlp / Prompt-Transferability
  On Transferability of Prompt Tuning for Natural Language Processing
  ☆100Updated last year
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆111Updated 2 years ago
• arazd / ProgressivePrompts
  Progressive Prompts: Continual Learning for Language Models
  ☆97Updated 2 years ago
• allenai / hyperdecoders
  Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304
  ☆13Updated 2 years ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated 2 years ago
• jiacheng-ye / ZeroGen
  [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.
  ☆48Updated 3 years ago
• yumeng5 / FewGen
  [ICML 2023] Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning
  ☆43Updated 2 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆50Updated 3 years ago
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• wutong8023 / PLM4CL
  ICLR 2022
  ☆18Updated 3 years ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆30Updated last year
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆63Updated 3 years ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• allenai / data-efficient-finetuning
  Code for paper 'Data-Efficient FineTuning'
  ☆28Updated 2 years ago
• HKUNLP / ZeroGen
  [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.
  ☆16Updated 3 years ago
• llyx97 / sparse-and-robust-PLM
  [NeurIPS 2022] "A Win-win Deal: Towards Sparse and Robust Pre-trained Language Models", Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li…
  ☆21Updated last year
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆66Updated 2 years ago
• Zce1112zslx / IKE
  ☆41Updated last year
• txsun1997 / Metric-Fairness
  EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
  ☆41Updated 2 years ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆74Updated 10 months ago
• rabeehk / hyperformer
  ☆158Updated 4 years ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆62Updated 2 years ago
• sunlab-osu / Understanding-CoT
  ☆88Updated 2 years ago
• yumeng5 / SuperGen
  [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
  ☆69Updated 3 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago