ejmichaud / grokking-squaredLinks
☆27Updated 2 years ago
Alternatives and similar repositories for grokking-squared
Users that are interested in grokking-squared are comparing it to the libraries listed below
Sorting:
- The Energy Transformer block, in JAX☆63Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Code for our paper "Generative Flow Networks for Discrete Probabilistic Modeling"☆87Updated 2 years ago
- ☆73Updated last year
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- Parallelizing non-linear sequential models over the sequence length☆56Updated 6 months ago
- A centralized place for deep thinking code and experiments☆88Updated 2 years ago
- [ICML'21] Improved Contrastive Divergence Training of Energy Based Models☆69Updated 3 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆81Updated 3 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆40Updated 2 years ago
- Code for "Bayesian Structure Learning with Generative Flow Networks"☆94Updated 3 years ago
- Efficient empirical NTKs in PyTorch☆22Updated 3 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 5 years ago
- ☆33Updated last year
- ☆34Updated 2 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆39Updated 3 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated 2 years ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆105Updated 2 years ago
- ☆12Updated last year
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Updated 4 years ago
- ☆30Updated 4 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆92Updated last year
- Deep Networks Grok All the Time and Here is Why☆38Updated last year
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆43Updated 6 years ago
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated 2 years ago
- Stochastic Automatic Differentiation library for PyTorch.☆208Updated last year
- ☆12Updated 2 years ago
- ☆54Updated last year
- ☆62Updated last year