Alternatives and similar repositories for grokking

Users that are interested in grokking are comparing it to the libraries listed below

• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆78Updated 6 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 5 years ago
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆79Updated 3 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆123Updated 4 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆59Updated 3 years ago
• fsschneider / DeepOBS
  DeepOBS: A Deep Learning Optimizer Benchmark Suite
  ☆106Updated last year
• g-benton / loss-surface-simplexes
  ☆100Updated 3 years ago
• thegregyang / GP4A
  Code for NeurIPS 2019 paper: "Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes…
  ☆246Updated 5 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 6 years ago
• google-deepmind / neural_testbed
  ☆191Updated 2 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆113Updated 5 years ago
• google-deepmind / mc_gradients
  ☆170Updated last year
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• openopt / chop
  CHOP: An optimization library based on PyTorch, with applications to adversarial examples and structured neural network training.
  ☆78Updated last year
• ganguli-lab / degrees-of-freedom
  ☆37Updated 3 years ago
• CalculatedContent / ImplicitSelfRegularization
  Repo to accompany paper "Implicit Self-Regularization in Deep Neural Networks..."
  ☆45Updated 6 years ago
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆61Updated 2 years ago
• james-simon / eigenlearning
  codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"
  ☆49Updated 2 years ago
• jxbz / fromage
  🧀 Pytorch code for the Fromage optimiser.
  ☆127Updated last year
• KarenUllrich / binary-VAE
  A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.
  ☆23Updated 5 years ago
• ejmichaud / grokking-squared
  ☆26Updated 2 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆86Updated 2 years ago
• akbir / deq-jax
  [NeurIPS'19] Deep Equilibrium Models Jax Implementation
  ☆40Updated 4 years ago
• lightonai / dfa-scales-to-modern-deep-learning
  Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…
  ☆90Updated 3 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆179Updated last week
• ayulockin / LossLandscape
  Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …
  ☆65Updated 5 years ago
• MichaelArbel / GeneralizedEBM
  ☆54Updated last year
• aangelopoulos / rcps
  Official codebase for "Distribution-Free, Risk-Controlling Prediction Sets"
  ☆85Updated last year