ejmichaud / grokking-squared
☆24Updated 2 years ago
Alternatives and similar repositories for grokking-squared:
Users that are interested in grokking-squared are comparing it to the libraries listed below
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆58Updated last year
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- The Energy Transformer block, in JAX☆56Updated last year
- ☆65Updated 3 months ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆76Updated 2 years ago
- PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆36Updated 3 years ago
- ☆61Updated 2 years ago
- [ICML'21] Improved Contrastive Divergence Training of Energy Based Models☆62Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆61Updated 3 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- Code for "Bayesian Structure Learning with Generative Flow Networks"☆84Updated 2 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆53Updated 2 years ago
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆20Updated last year
- ☆49Updated 4 years ago
- Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"☆82Updated 2 years ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 2 years ago
- [NeurIPS'19] Deep Equilibrium Models Jax Implementation☆39Updated 4 years ago
- Official code for UnICORNN (ICML 2021)☆27Updated 3 years ago
- ☆26Updated last year
- ☆22Updated 3 years ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆104Updated last year
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 2 years ago
- Experiments for Meta-Learning Symmetries by Reparameterization☆56Updated 3 years ago
- Parallelizing non-linear sequential models over the sequence length☆51Updated 2 months ago
- Code for minimum-entropy coupling.☆31Updated 8 months ago
- Code for Neural Execution Engines: Learning to Execute Subroutines☆17Updated 4 years ago
- Code for the paper: "Independent mechanism analysis, a new concept?"☆24Updated last year
- ZeroC is a neuro-symbolic method that trained with elementary visual concepts and relations, can zero-shot recognize and acquire more com…☆30Updated last year