rabeehk / hyperformer
☆149Updated 3 years ago
Related projects: ⓘ
- This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)☆96Updated last year
- ☆127Updated 2 years ago
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆56Updated 7 months ago
- Code for paper "UniPELT: A Unified Framework for Parameter-Efficient Language Model Tuning", ACL 2022☆58Updated 2 years ago
- The code for lifelong few-shot language learning☆53Updated 2 years ago
- Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"☆38Updated 2 years ago
- VaLM: Visually-augmented Language Modeling. ICLR 2023.☆55Updated last year
- ☆49Updated last year
- Progressive Prompts: Continual Learning for Language Models☆87Updated last year
- On the Effectiveness of Parameter-Efficient Fine-Tuning☆38Updated 10 months ago
- Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".☆80Updated 2 years ago
- [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"☆49Updated last year
- An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi☆249Updated last year
- Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models☆134Updated 2 years ago
- Language modeling via stochastic processes. Oral @ ICLR 2022.☆134Updated last year
- FlatNCE: A Novel Contrastive Representation Learning Objective☆83Updated 2 years ago
- Released code for our ICLR23 paper.☆62Updated last year
- ☆164Updated last month
- ICLR 2022☆17Updated 2 years ago
- Source code for paper "Contrastive Out-of-Distribution Detection for Pretrained Transformers", EMNLP 2021☆40Updated 2 years ago
- Implementation for Variational Information Bottleneck for Effective Low-resource Fine-tuning, ICLR 2021☆36Updated 3 years ago
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆36Updated last year
- Active Example Selection for In-Context Learning (EMNLP'22)☆43Updated last month
- [NeurIPS 2022 Workshop] A Case Study with Negated Prompts using T0 (3B, 11B), InstructGPT (350M-175B), GPT-3 (350M - 175B) & OPT (125M - …☆23Updated last year
- [ICLR 2022] Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners☆127Updated last year
- contrastive decoding☆174Updated last year
- [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"☆105Updated last year
- Code and Experiments for ACL-IJCNLP 2021 Paper "Mind Your Outliers! Investigating the Negative Impact of Outliers on Active Learning for …☆56Updated 2 years ago
- ☆32Updated last year
- This package implements THOR: Transformer with Stochastic Experts.☆60Updated 2 years ago