teddykoker / grokkingLinks
PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
☆37Updated 3 years ago
Alternatives and similar repositories for grokking
Users that are interested in grokking are comparing it to the libraries listed below
Sorting:
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- paper lists and information on mean-field theory of deep learning☆78Updated 6 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 5 years ago
- Hessian spectral density estimation in TF and Jax☆124Updated 5 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- Structured matrices for compressing neural networks☆67Updated last year
- This repository contains the Julia code for the paper "Competitive Gradient Descent"☆25Updated 5 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆59Updated 3 years ago
- Code for NeurIPS 2019 paper: "Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes…☆246Updated 5 years ago
- ☆100Updated 3 years ago
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆106Updated last year
- A centralized place for deep thinking code and experiments☆86Updated 2 years ago
- Collection of algorithms for approximating Fisher Information Matrix for Natural Gradient (and second order method in general)☆140Updated 6 years ago
- ☆170Updated last year
- CHOP: An optimization library based on PyTorch, with applications to adversarial examples and structured neural network training.☆78Updated last year
- Differentiable Algorithms and Algorithmic Supervision.☆116Updated 2 years ago
- A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.☆23Updated 5 years ago
- Convolutional Neural Tangent Kernel☆112Updated 5 years ago
- 👩 Pytorch and Jax code for the Madam optimiser.☆52Updated 4 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆181Updated this week
- Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"☆73Updated 9 years ago
- Some small scale experiments for my blog posts 📝☆79Updated 3 years ago
- ☆192Updated 2 months ago
- Codebase for Learning Invariances in Neural Networks☆96Updated 2 years ago
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- Optimizing PAC-Bayes bounds for Stochastic Neural Networks with Gaussian weights☆28Updated 4 years ago
- ☆33Updated 5 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆112Updated 3 years ago
- ☆36Updated 2 years ago
- Repo to accompany paper "Implicit Self-Regularization in Deep Neural Networks..."☆45Updated 6 years ago