ejmichaud / grokking-squaredLinks
☆26Updated 2 years ago
Alternatives and similar repositories for grokking-squared
Users that are interested in grokking-squared are comparing it to the libraries listed below
Sorting:
- ☆70Updated 9 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆42Updated 6 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆61Updated 2 years ago
- The Energy Transformer block, in JAX☆59Updated last year
- A centralized place for deep thinking code and experiments☆86Updated 2 years ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆108Updated last year
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆38Updated 2 years ago
- ☆68Updated 2 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆88Updated last year
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- Parallelizing non-linear sequential models over the sequence length☆54Updated 2 months ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 4 years ago
- Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"☆84Updated 2 years ago
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆16Updated 2 years ago
- [ICML'21] Improved Contrastive Divergence Training of Energy Based Models☆65Updated 3 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 5 years ago
- ☆33Updated 2 years ago
- Official repository for the paper "Going Beyond Linear Transformers with Recurrent Fast Weight Programmers" (NeurIPS 2021)☆50Updated 3 months ago
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- Code for "Bayesian Structure Learning with Generative Flow Networks"☆89Updated 3 years ago
- ☆37Updated last year
- ☆56Updated 5 months ago
- ☆61Updated 3 years ago
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆18Updated 10 months ago
- Official code for UnICORNN (ICML 2021)☆28Updated 3 years ago
- Code repository for "The Clock and the Pizza: Two Stories in Mechanistic Explanation of Neural Networks"☆17Updated last year
- Code for minimum-entropy coupling.☆32Updated last year