SwordElucidator / nanoBackpackLMLinks
The simplest repository for training medium-sized BackpackLM for cs224n
☆25Updated 2 years ago
Alternatives and similar repositories for nanoBackpackLM
Users that are interested in nanoBackpackLM are comparing it to the libraries listed below
Sorting:
- The original Backpack Language Model implementation, a fork of FlashAttention☆69Updated 2 years ago
- ☆13Updated last year
- Transformers at any scale☆41Updated last year
- ☆24Updated 2 years ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆59Updated 2 years ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Updated 3 years ago
- Adding new tasks to T0 without catastrophic forgetting☆33Updated 3 years ago
- EMNLP 2022: Finding Dataset Shortcuts with Grammar Induction https://arxiv.org/abs/2210.11560☆57Updated 8 months ago
- [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective☆37Updated 2 years ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆32Updated last year
- code for "Natural Language to Code Translation with Execution"☆41Updated 3 years ago
- An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation☆27Updated last year
- Retrieval as Attention☆82Updated 2 years ago
- [AAAI 2024] Investigating the Effectiveness of Task-Agnostic Prefix Prompt for Instruction Following☆78Updated last year
- Staged Training for Transformer Language Models☆33Updated 3 years ago
- ☆22Updated 2 years ago
- Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings☆16Updated 2 years ago
- [EACL 2023] CoTEVer: Chain of Thought Prompting Annotation Toolkit for Explanation Verification☆41Updated 2 years ago
- ☆35Updated last year
- [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees☆24Updated 2 years ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆22Updated last year
- BLOOM+1: Adapting BLOOM model to support a new unseen language☆74Updated last year
- Code for RL4F: Generating Natural Language Feedback with Reinforcement Learning for Repairing Model Outputs. ACL 2023.☆64Updated 11 months ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆136Updated last year
- The official implementation of "Distilling Relation Embeddings from Pre-trained Language Models, EMNLP 2021 main conference", a high-qual…☆47Updated 11 months ago
- Embedding Recycling for Language models☆38Updated 2 years ago
- SILO Language Models code repository☆83Updated last year
- Repo for "On Learning to Summarize with Large Language Models as References"☆43Updated 2 years ago
- Align, a general text alignment function☆15Updated last year
- Task Compass: Scaling Multi-task Pre-training with Task Prefix (EMNLP 2022: Findings) (stay tuned & more will be updated)☆22Updated 3 years ago