IDSIA / modern-srwmLinks
Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)
☆170Updated last year
Alternatives and similar repositories for modern-srwm
Users that are interested in modern-srwm are comparing it to the libraries listed below
Sorting:
- Hierarchical Associative Memory User Experience☆100Updated last year
- Easy Hypernetworks in Pytorch and Jax☆100Updated 2 years ago
- Gaussian-Bernoulli Restricted Boltzmann Machines☆104Updated 2 years ago
- Unofficial JAX implementations of deep learning research papers☆156Updated 2 years ago
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆81Updated 3 years ago
- ☆192Updated last month
- The Energy Transformer block, in JAX☆56Updated last year
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆49Updated 2 years ago
- The Abstraction and Reasoning Corpus made into a web game☆89Updated 9 months ago
- ☆246Updated 3 weeks ago
- Official Implementation of the ICML 2023 paper: "Neural Wave Machines: Learning Spatiotemporally Structured Representations with Locally …☆72Updated 2 years ago
- Neural Turing Machines in pytorch☆48Updated 3 years ago
- Code for 1st place solution to Kaggle's Abstraction and Reasoning Challenge☆157Updated 4 years ago
- Neural Networks and the Chomsky Hierarchy☆205Updated last year
- Official code repository of the paper Linear Transformers Are Secretly Fast Weight Programmers.☆105Updated 3 years ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆94Updated 6 months ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- Running Jax in PyTorch Lightning☆102Updated 5 months ago
- Language-annotated Abstraction and Reasoning Corpus☆86Updated 2 years ago
- Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All…☆169Updated 2 years ago
- ☆106Updated 3 years ago
- Automatic gradient descent☆207Updated last year
- Implementation of Hierarchical Transformer Memory (HTM) for Pytorch☆74Updated 3 years ago
- Code for the paper "Predictive Coding Approximates Backprop along Arbitrary Computation Graphs"☆156Updated 4 years ago
- Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.☆254Updated 2 months ago
- Code for "Meta Learning Backpropagation And Improving It" @ NeurIPS 2021 https://arxiv.org/abs/2012.14905☆32Updated 3 years ago
- ☆39Updated 3 years ago
- A pure-functional implementation of a machine learning transformer model in Python/JAX☆179Updated 3 weeks ago
- Implementation of PSGD optimizer in JAX☆33Updated 5 months ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆100Updated 2 years ago