teddykoker / grokkingLinks
PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
☆37Updated 3 years ago
Alternatives and similar repositories for grokking
Users that are interested in grokking are comparing it to the libraries listed below
Sorting:
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆78Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- ☆26Updated 2 years ago
- ☆51Updated last month
- Hessian spectral density estimation in TF and Jax☆123Updated 4 years ago
- Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube☆47Updated 5 years ago
- [NeurIPS'19] Deep Equilibrium Models Jax Implementation☆39Updated 4 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆59Updated 3 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆175Updated this week
- Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited☆37Updated 2 years ago
- Omnigrok: Grokking Beyond Algorithmic Data☆58Updated 2 years ago
- A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.☆22Updated 5 years ago
- Composable kernels for scikit-learn implemented in JAX.☆43Updated 4 years ago
- ☆99Updated 3 years ago
- ☆37Updated 3 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆37Updated 2 years ago
- Official code for UnICORNN (ICML 2021)☆27Updated 3 years ago
- Optimizing PAC-Bayes bounds for Stochastic Neural Networks with Gaussian weights☆27Updated 4 years ago
- ☆80Updated 3 years ago
- Repo to accompany paper "Implicit Self-Regularization in Deep Neural Networks..."☆44Updated 6 years ago
- Jupyter Notebook corresponding to 'Going with the Flow: An Introduction to Normalizing Flows'☆26Updated 4 years ago
- paper lists and information on mean-field theory of deep learning☆76Updated 6 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"☆49Updated 2 years ago
- ☆33Updated 5 years ago
- Some small scale experiments for my blog posts 📝☆79Updated 2 years ago
- ☆10Updated 2 years ago
- code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"☆26Updated 2 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago