IDSIA / modern-srwm
Official repository for the paper "A Modern Self-Referential Weight Matrix That Learns to Modify Itself" (ICML 2022 & NeurIPS 2021 Deep RL Workshop) and "Accelerating Neural Self-Improvement via Bootstrapping" (ICLR 2023 Workshop)
☆168Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for modern-srwm
- Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All…☆166Updated last year
- Neural Networks and the Chomsky Hierarchy☆187Updated 7 months ago
- ☆240Updated last month
- Hierarchical Associative Memory User Experience☆89Updated 10 months ago
- ☆191Updated 6 months ago
- Easy Hypernetworks in Pytorch and Jax☆96Updated last year
- Cellular Automata Accelerated in JAX☆70Updated 2 weeks ago
- Language-annotated Abstraction and Reasoning Corpus☆78Updated last year
- The Abstraction and Reasoning Corpus made into a web game☆86Updated 2 months ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- The Energy Transformer block, in JAX☆53Updated 11 months ago
- ☆101Updated 2 years ago
- A functional training loops library for JAX☆85Updated 9 months ago
- ☆48Updated last year
- A library that makes Evolutionary Strategies (ES) simple to use.☆179Updated 3 years ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆258Updated last year
- Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes☆237Updated last year
- Automatic gradient descent☆206Updated last year
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆79Updated 3 years ago
- Implementation of Hierarchical Transformer Memory (HTM) for Pytorch☆72Updated 3 years ago
- ☆52Updated 2 years ago
- ☆153Updated 11 months ago
- ☆56Updated 2 years ago
- Code for the paper "Predictive Coding Approximates Backprop along Arbitrary Computation Graphs"☆149Updated 3 years ago
- Code for "Meta Learning Backpropagation And Improving It" @ NeurIPS 2021 https://arxiv.org/abs/2012.14905☆31Updated 2 years ago
- Stochastic Automatic Differentiation library for PyTorch.☆180Updated 2 months ago
- Differentiable Algorithms and Algorithmic Supervision.☆105Updated last year
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆86Updated 10 months ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 2 years ago