google-deepmind / neural_networks_chomsky_hierarchyView external linksLinks
Neural Networks and the Chomsky Hierarchy
☆214Apr 12, 2024Updated last year
Alternatives and similar repositories for neural_networks_chomsky_hierarchy
Users that are interested in neural_networks_chomsky_hierarchy are comparing it to the libraries listed below
Sorting:
- Code for the paper "Stack Attention: Improving the Ability of Transformers to Model Hierarchical Patterns"☆18Mar 15, 2024Updated last year
- Code for the paper "The Surprising Computational Power of Nondeterministic Stack RNNs" (DuSell and Chiang, 2023)☆19Mar 21, 2024Updated last year
- Stack neural networks applied to hefty natural language tasks.☆15Dec 26, 2019Updated 6 years ago
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Jun 6, 2024Updated last year
- ☆29Jul 9, 2024Updated last year
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Apr 17, 2024Updated last year
- Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep R…☆176Jun 11, 2025Updated 8 months ago
- Learning Universal Predictors☆81Aug 1, 2024Updated last year
- ☆35Feb 26, 2024Updated last year
- ☆11Oct 11, 2023Updated 2 years ago
- MARNNs Can Learn Generalized Dyck Languages☆12Nov 11, 2019Updated 6 years ago
- [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation☆61Updated this week
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆66Apr 24, 2024Updated last year
- Supplementary Data for Evolving Reinforcement Learning Algorithms☆47Mar 15, 2021Updated 4 years ago
- Recursive Bayesian Networks☆11May 11, 2025Updated 9 months ago
- Combining SOAP and MUON☆19Feb 11, 2025Updated last year
- Official Repository of Pretraining Without Attention (BiGS), BiGS is the first model to achieve BERT-level transfer learning on the GLUE …☆116Mar 16, 2024Updated last year
- ☆14Feb 1, 2024Updated 2 years ago
- Language of thought library for python 3☆50Feb 14, 2024Updated 2 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆56Aug 20, 2024Updated last year
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆98Dec 5, 2024Updated last year
- Fine-Tuning Pre-trained Transformers into Decaying Fast Weights☆19Oct 9, 2022Updated 3 years ago
- ☆84Aug 31, 2023Updated 2 years ago
- Convolutions for Sequence Modeling☆911Jun 13, 2024Updated last year
- ☆35Nov 22, 2024Updated last year
- Causal Analysis of Agent Behavior for AI Safety☆19Jun 27, 2023Updated 2 years ago
- A MAD laboratory to improve AI architecture designs 🧪☆138Dec 17, 2024Updated last year
- Learning Features with Parameter-Free Layers, ICLR 2022☆84May 3, 2023Updated 2 years ago
- Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.☆16Nov 1, 2021Updated 4 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Jan 23, 2024Updated 2 years ago
- ☆28Jul 28, 2022Updated 3 years ago
- Official Code Repository for the paper "Key-value memory in the brain"☆31Feb 25, 2025Updated 11 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆92Jun 18, 2024Updated last year
- Learning Representations that Support Robust Transfer of Predictors☆20Nov 7, 2021Updated 4 years ago
- ☆45Apr 30, 2018Updated 7 years ago
- Docker containers of baseline agents for the Crafter environment☆30Dec 14, 2021Updated 4 years ago
- Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"☆87Feb 22, 2023Updated 2 years ago
- Pip-installable differentiable stacks in PyTorch!☆65Oct 23, 2020Updated 5 years ago
- Library for reading and processing ML training data.☆683Updated this week