Alternatives and similar repositories for hyperformer:

Users that are interested in hyperformer are comparing it to the libraries listed below

• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• rabeehk / compacter
  ☆128Updated 2 years ago
• McGill-NLP / polytropon
  ☆53Updated 2 years ago
• morningmoni / UniPELT
  Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022
  ☆59Updated 3 years ago
• rabeehk / vibert
  Implementation for Variational Information Bottleneck for Effective Low-resource Fine-tuning, ICLR 2021
  ☆39Updated 3 years ago
• qcwthu / Lifelong-Fewshot-Language-Learning
  The code for lifelong few-shot language learning
  ☆55Updated 3 years ago
• SALT-NLP / Adaptive-Compositional-Modules
  Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"
  ☆38Updated 3 years ago
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated 2 years ago
• facebookresearch / MetaICL
  An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi
  ☆264Updated 2 years ago
• wutong8023 / PLM4CL
  ICLR 2022
  ☆17Updated 3 years ago
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated 2 years ago
• guanzhchen / PETuning
  ☆34Updated 2 years ago
• arazd / ProgressivePrompts
  Progressive Prompts: Continual Learning for Language Models
  ☆93Updated 2 years ago
• SALT-NLP / IDBR
  Codes for the paper: "Continual Learning for Text Classification with Information Disentanglement Based Regularization"
  ☆44Updated 2 years ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆109Updated last year
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• joeljang / continual-knowledge-learning
  [ICLR 2022] Towards Continual Knowledge Learning of Language Models
  ☆92Updated 2 years ago
• BeyonderXX / TRACE
  TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models
  ☆67Updated last year
• wzhouad / Contra-OOD
  Source code for paper "Contrastive Out-of-Distribution Detection for Pretrained Transformers", EMNLP 2021
  ☆40Updated 3 years ago
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆45Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• HKUNLP / icl-ceil
  [ICML 2023] Code for our paper “Compositional Exemplars for In-context Learning”.
  ☆100Updated 2 years ago
• DavidFanzz / llm_decoding
  ☆12Updated last week
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆137Updated 3 years ago
• rosewang2008 / language_modeling_via_stochastic_processes
  Language modeling via stochastic processes. Oral @ ICLR 2022.
  ☆138Updated last year
• GXimingLu / Quark
  ☆75Updated last year
• uds-lsv / MCSE
  NAACL 2022: MCSE: Multimodal Contrastive Learning of Sentence Embeddings
  ☆55Updated 10 months ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• john-hewitt / backpacks-flash-attn
  The original Backpack Language Model implementation, a fork of FlashAttention
  ☆67Updated last year
• google-deepmind / emergent_in_context_learning
  ☆83Updated 9 months ago