UIC-Liu-Lab / CPT
[EMNLP 2022] Continual Training of Language Models for Few-Shot Learning
☆44Updated 2 years ago
Alternatives and similar repositories for CPT:
Users that are interested in CPT are comparing it to the libraries listed below
- [EMNLP 2022] Adapting a Language Model While Preserving its General Knowledge☆21Updated 2 years ago
- Adding new tasks to T0 without catastrophic forgetting☆32Updated 2 years ago
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆64Updated last year
- This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)☆100Updated 2 years ago
- The code for lifelong few-shot language learning☆55Updated 2 years ago
- ☆32Updated 2 years ago
- Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"☆32Updated 9 months ago
- Code for the ACL 2022 paper "Continual Sequence Generation with Adaptive Compositional Modules"☆38Updated 2 years ago
- ☆25Updated last year
- ICLR 2022☆17Updated 2 years ago
- ☆40Updated last year
- Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…☆58Updated 2 years ago
- Methods and evaluation for aligning language models temporally☆27Updated 11 months ago
- [ICML 2023] Tuning Language Models as Training Data Generators for Augmentation-Enhanced Few-Shot Learning☆40Updated last year
- Codes for the paper: "Continual Learning for Text Classification with Information Disentanglement Based Regularization"☆44Updated 2 years ago
- ☆52Updated last year
- [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$☆39Updated 3 months ago
- Progressive Prompts: Continual Learning for Language Models☆91Updated last year
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆69Updated last year
- Learning adapter weights from task descriptions☆15Updated last year
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆66Updated 2 years ago
- DEMix Layers for Modular Language Modeling☆53Updated 3 years ago
- [NeurIPS 2022] Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings☆21Updated 2 years ago
- Implementation for Variational Information Bottleneck for Effective Low-resource Fine-tuning, ICLR 2021☆38Updated 3 years ago
- Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs☆34Updated last year
- Visual and Embodied Concepts evaluation benchmark☆21Updated last year
- ☆32Updated last year
- [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.☆46Updated 2 years ago
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆48Updated last year
- Directional Preference Alignment☆54Updated 4 months ago