Alternatives and similar repositories for grokking

Users that are interested in grokking are comparing it to the libraries listed below

• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆78Updated 2 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• akbir / deq-jax
  [NeurIPS'19] Deep Equilibrium Models Jax Implementation
  ☆39Updated 4 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆123Updated 4 years ago
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆58Updated 2 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 4 years ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆59Updated last year
• aradha / recursive_feature_machines
  ☆55Updated 2 months ago
• gehring / fax
  ☆80Updated 3 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆78Updated 6 years ago
• ejmichaud / grokking-squared
  ☆26Updated 2 years ago
• rolandgvc / flaxvision
  A selection of neural network models ported from torchvision for JAX & Flax.
  ☆44Updated 4 years ago
• cunningham-lab / cb_and_cc
  ☆36Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆177Updated 2 weeks ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆59Updated 3 years ago
• gebob19 / introduction_to_normalizing_flows
  Jupyter Notebook corresponding to 'Going with the Flow: An Introduction to Normalizing Flows'
  ☆26Updated 4 years ago
• thegregyang / NNspectra
  Computing the eigenvalues of Neural Tangent Kernel and Conjugate Kernel (aka NNGP kernel) over the boolean cube
  ☆47Updated 5 years ago
• KarenUllrich / binary-VAE
  A minimal implementation of a VAE with BinConcrete (relaxed Bernoulli) latent distribution in TensorFlow.
  ☆22Updated 5 years ago
• cgarciae / nanoGPT-jax
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆33Updated last year
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆37Updated 2 years ago
• g-benton / hessian-eff-dim
  Public Codebase for Rethinking Parameter Counting: Effective Dimensionality Revisited
  ☆37Updated 2 years ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated 3 months ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• f-t-s / CGD
  This repository contains the Julia code for the paper "Competitive Gradient Descent"
  ☆25Updated 5 years ago
• SaitejaUtpala / rieoptax
  Riemannian Optimization Using JAX
  ☆49Updated last year
• locuslab / monotone_op_net
  Monotone operator equilibrium networks
  ☆52Updated 5 years ago
• kazukiosawa / ngd_in_wide_nn
  simple JAX-/NumPy-based implementations of NGD with exact/approximate Fisher Information Matrix both in parameter-space and function-spac…
  ☆14Updated 4 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆67Updated 6 years ago
• ganguli-lab / degrees-of-freedom
  ☆37Updated 3 years ago
• locuslab / edge-of-stability
  ☆68Updated 6 months ago