Alternatives and similar repositories for grokking

Users that are interested in grokking are comparing it to the libraries listed below

• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆63Updated 4 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated 2 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆106Updated 5 years ago
• thegregyang / GP4A
  Code for NeurIPS 2019 paper: "Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes…
  ☆248Updated 5 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆60Updated 3 years ago
• fwcore / mean-field-theory-deep-learning
  paper lists and information on mean-field theory of deep learning
  ☆78Updated 6 years ago
• g-benton / loss-surface-simplexes
  ☆100Updated 3 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆112Updated 6 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆124Updated 5 years ago
• openopt / chop
  CHOP: An optimization library based on PyTorch, with applications to adversarial examples and structured neural network training.
  ☆78Updated last year
• fsschneider / DeepOBS
  DeepOBS: A Deep Learning Optimizer Benchmark Suite
  ☆109Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆79Updated 3 years ago
• HEmile / storchastic
  Stochastic Automatic Differentiation library for PyTorch.
  ☆208Updated last year
• jxbz / madam
  👩 Pytorch and Jax code for the Madam optimiser.
  ☆53Updated 4 years ago
• cybertronai / pytorch-sso
  PyTorch-SSO: Scalable Second-Order methods in PyTorch
  ☆148Updated 2 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆148Updated 2 years ago
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆51Updated last year
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆190Updated last year
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆188Updated last month
• g-benton / learning-invariances
  Codebase for Learning Invariances in Neural Networks
  ☆96Updated 3 years ago
• jxbz / fromage
  🧀 Pytorch code for the Fromage optimiser.
  ☆129Updated last year
• srush / parallax
  ☆153Updated 5 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆87Updated 2 years ago
• CalculatedContent / ImplicitSelfRegularization
  Repo to accompany paper "Implicit Self-Regularization in Deep Neural Networks..."
  ☆46Updated 6 years ago
• f-t-s / CGD
  This repository contains the Julia code for the paper "Competitive Gradient Descent"
  ☆25Updated 5 years ago
• RobertTLange / code-and-blog
  Some small scale experiments for my blog posts 📝
  ☆79Updated 3 years ago
• google-deepmind / neural_testbed
  ☆192Updated 5 months ago
• bobby-he / Neural_Tangent_Kernel
  ☆68Updated 6 years ago
• ganguli-lab / deepchaos
  Experiments for the paper "Exponential expressivity in deep neural networks through transient chaos"
  ☆74Updated 9 years ago
• akbir / deq-jax
  [NeurIPS'19] Deep Equilibrium Models Jax Implementation
  ☆42Updated 5 years ago