MurtyShikhar / Pushdown-LayersLinks
Code for Pushdown Layers from our EMNLP 2023 paper
☆28Updated last year
Alternatives and similar repositories for Pushdown-Layers
Users that are interested in Pushdown-Layers are comparing it to the libraries listed below
Sorting:
- Experiments on the impact of depth in transformers and SSMs.☆32Updated 8 months ago
- ☆20Updated last year
- ☆51Updated 2 years ago
- ☆32Updated last year
- lanmt ebm☆12Updated 5 years ago
- ☆48Updated last year
- ☆45Updated last year
- source code of NAACL2021 "PCFGs Can Do Better: Inducing Probabilistic Context-Free Grammars with Many Symbols“ and ACL2021 main conferenc…☆50Updated 3 months ago
- ☆11Updated last year
- Stick-breaking attention☆58Updated 2 weeks ago
- Learning to Model Editing Processes☆26Updated 3 years ago
- Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"☆58Updated 2 years ago
- Efficient Transformers with Dynamic Token Pooling☆63Updated 2 years ago
- ☆29Updated 3 years ago
- ☆56Updated last year
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆33Updated last month
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆37Updated last year
- Code for our ACL '23 paper titled "Grokking of Hierarchical Structure in Vanilla Transformers"☆21Updated last year
- Code for "Discovering Non-monotonic Autoregressive Orderings with Variational Inference" (paper and code updated from ICLR 2021)☆12Updated last year
- ☆31Updated 2 years ago
- ☆18Updated last year
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Updated 2 years ago
- ☆32Updated last year
- ☆14Updated 2 years ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆19Updated 11 months ago
- ☆34Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- Xmixers: A collection of SOTA efficient token/channel mixers☆11Updated last week
- ☆51Updated last year
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆23Updated 2 months ago