Alternatives and similar repositories for TP4:

Users that are interested in TP4 are comparing it to the libraries listed below

• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 4 years ago
• google / spectral-density
  Hessian spectral density estimation in TF and Jax
  ☆122Updated 4 years ago
• locuslab / edge-of-stability
  ☆65Updated 3 months ago
• g-benton / loss-surface-simplexes
  ☆99Updated 3 years ago
• aks2203 / deep-thinking
  A centralized place for deep thinking code and experiments
  ☆82Updated last year
• Sea-Snell / grokking
  unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆76Updated 2 years ago
• google-research / jax-influence
  ☆60Updated 3 years ago
• teddykoker / grokking
  PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"
  ☆36Updated 3 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆66Updated last year
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆109Updated 5 years ago
• bobby-he / Neural_Tangent_Kernel
  ☆66Updated 6 years ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• choidami / sst
  ☆49Updated 4 years ago
• aks2203 / easy-to-hard
  Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"
  ☆60Updated 3 years ago
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆58Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆60Updated last year
• james-simon / eigenlearning
  codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"
  ☆50Updated last year
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆49Updated last year
• js-d / sim_metric
  ☆35Updated last year
• tml-epfl / sgd-sparse-features
  SGD with large step sizes learns sparse features [ICML 2023]
  ☆32Updated last year
• ejmichaud / grokking-squared
  ☆24Updated 2 years ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆130Updated 5 years ago
• damaru2 / ntk
  NTK reading group
  ☆88Updated 5 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆170Updated 3 months ago
• rgrosse / csc2541_examples
  ☆29Updated 4 years ago
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 3 years ago
• mpezeshki / Epoch_wise_Double_Descent
  Official implementation of "Multi-scale Feature Learning Dynamics: Insights for Double Descent".
  ☆16Updated 2 years ago