ejmichaud / grokking-squaredLinks
☆26Updated 2 years ago
Alternatives and similar repositories for grokking-squared
Users that are interested in grokking-squared are comparing it to the libraries listed below
Sorting:
- The Energy Transformer block, in JAX☆59Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Omnigrok: Grokking Beyond Algorithmic Data☆61Updated 2 years ago
- Parallelizing non-linear sequential models over the sequence length☆54Updated 2 months ago
- Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"☆84Updated 2 years ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆108Updated last year
- ☆32Updated 10 months ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- A centralized place for deep thinking code and experiments☆86Updated 2 years ago
- Code for "Bayesian Structure Learning with Generative Flow Networks"☆89Updated 3 years ago
- Code repository for "The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks"☆17Updated last year
- Official repository for the paper "Exploring the Promise and Limits of Real-Time Recurrent Learning" (ICLR 2024)☆13Updated 2 months ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆42Updated 6 years ago
- Official code for UnICORNN (ICML 2021)☆28Updated 3 years ago
- ☆30Updated 5 months ago
- ☆36Updated 2 years ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Updated 3 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- ☆70Updated 8 months ago
- ☆68Updated 2 years ago
- ☆33Updated 2 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆87Updated last year
- Blog post☆17Updated last year
- [ICML'21] Improved Contrastive Divergence Training of Energy Based Models☆63Updated 3 years ago
- ☆238Updated last year
- Distributed K-FAC preconditioner for PyTorch☆89Updated last week
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆21Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- ☆29Updated 4 years ago