KindXiaoming / Omnigrok
Omnigrok: Grokking Beyond Algorithmic Data
☆53Updated 2 years ago
Alternatives and similar repositories for Omnigrok:
Users that are interested in Omnigrok are comparing it to the libraries listed below
- Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.☆35Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆72Updated 2 years ago
- ☆65Updated 2 months ago
- ☆24Updated 2 years ago
- Agustinus' very opiniated publication-ready plotting library☆61Updated last month
- ☆16Updated 5 months ago
- ☆213Updated 9 months ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆165Updated last year
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆35Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- Deep Learning & Information Bottleneck☆57Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆59Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆168Updated 2 months ago
- ☆78Updated last year
- Sparse Autoencoder Training Library☆42Updated 4 months ago
- PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)☆32Updated this week
- PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆35Updated 3 years ago
- ☆57Updated 3 months ago
- Transformers with doubly stochastic attention☆45Updated 2 years ago
- Universal Neurons in GPT2 Language Models☆27Updated 9 months ago
- ☆61Updated 2 years ago
- A centralized place for deep thinking code and experiments☆82Updated last year
- ☆110Updated 6 months ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- Implementation of Action Matching☆38Updated last year
- Neural Tangent Kernel Papers☆106Updated last month
- ☆49Updated last year
- ☆161Updated 3 months ago
- Code associated to papers on superposition (in ML interpretability)☆28Updated 2 years ago
- Influence Functions with (Eigenvalue-corrected) Kronecker-Factored Approximate Curvature☆136Updated 7 months ago