LumenPallidium / energy_transformer
Pytorch implementation of an energy transformer - an energy-based reccurrent variant of the transformer.
☆11Updated last year
Related projects ⓘ
Alternatives and complementary repositories for energy_transformer
- The Energy Transformer block, in JAX☆50Updated 11 months ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 2 years ago
- ☆36Updated 2 years ago
- ☆14Updated 3 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated last year
- Solving the Abstraction & Reasoning Corpus with DreamCoder☆31Updated last month
- ☆24Updated last year
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆58Updated 3 years ago
- Code for the paper "Attention Approximates Sparse Distributed Memory"☆22Updated 2 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆34Updated last year
- Code associated to papers on superposition (in ML interpretability)☆24Updated 2 years ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆47Updated last year
- ☆18Updated last year
- Bayesian model reduction for probabilistic machine learning☆10Updated 9 months ago
- Public repository for the Thermodynamic Neural Network File☆13Updated 4 years ago
- Official repository for the paper "Neural Differential Equations for Learning to Program Neural Nets Through Continuous Learning Rules" (…☆18Updated 2 years ago
- ☆22Updated last year
- Language-annotated Abstraction and Reasoning Corpus☆78Updated last year
- This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classificatio…☆20Updated 9 months ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆53Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated last year
- A programming language for formal/informal computation.☆40Updated 5 months ago
- Usable implementation of Emerging Symbol Binding Network (ESBN), in Pytorch☆23Updated 3 years ago
- Python implementation of the methods in Meulemans et al. 2020 - A Theoretical Framework For Target Propagation☆28Updated last week
- ☆28Updated last year
- Universal Neurons in GPT2 Language Models☆26Updated 5 months ago
- PyTorch Package For Quasimetric Learning☆42Updated last week
- ☆54Updated 2 years ago
- Automatic Hebbian learning in multi-layer convolutional networks with PyTorch, by expressing Hebbian plasticity rules as gradients☆37Updated last year
- A centralized place for deep thinking code and experiments☆76Updated last year