IDSIA / modern-srwm
Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)
☆170Updated last year
Alternatives and similar repositories for modern-srwm:
Users that are interested in modern-srwm are comparing it to the libraries listed below
- Easy Hypernetworks in Pytorch and Jax☆98Updated 2 years ago
- Hierarchical Associative Memory User Experience☆98Updated last year
- Neural Networks and the Chomsky Hierarchy☆204Updated 10 months ago
- Neural Turing Machines in pytorch☆48Updated 3 years ago
- Automatic gradient descent☆207Updated last year
- ☆245Updated 5 months ago
- ☆191Updated 9 months ago
- The Energy Transformer block, in JAX☆56Updated last year
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 3 years ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆80Updated 3 years ago
- Gaussian-Bernoulli Restricted Boltzmann Machines☆102Updated 2 years ago
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆102Updated 3 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- The Abstraction and Reasoning Corpus made into a web game☆89Updated 6 months ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆48Updated last year
- Image augmentation library for Jax☆38Updated 11 months ago
- A functional training loops library for JAX☆86Updated last year
- Code for the paper "Predictive Coding Approximates Backprop along Arbitrary Computation Graphs"☆151Updated 4 years ago
- ☆37Updated 2 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆91Updated 3 months ago
- Language-annotated Abstraction and Reasoning Corpus☆82Updated last year
- A PyTorch implementation of a Generative Flow Network (GFlowNet) proposed by Bengio et al. (2021)☆42Updated last year
- ☆16Updated 6 months ago
- A collection of meta-learning algorithms in Jax☆22Updated 2 years ago
- Official Implementation of the ICML 2023 paper: "Neural Wave Machines: Learning Spatiotemporally Structured Representations with Locally …☆69Updated last year
- Code for "Meta Learning Backpropagation And Improving It" @ NeurIPS 2021 https://arxiv.org/abs/2012.14905☆31Updated 3 years ago
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆236Updated last year
- Pretrained models for Jax/Haiku; MobileNet, ResNet, VGG, Xception.☆23Updated 2 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆74Updated 2 years ago