TrentBrick / SDMContinualLearnerLinks
☆20Updated 2 years ago
Alternatives and similar repositories for SDMContinualLearner
Users that are interested in SDMContinualLearner are comparing it to the libraries listed below
Sorting:
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆27Updated 2 years ago
- ☆26Updated 2 years ago
- Parallelizing non-linear sequential models over the sequence length☆54Updated 4 months ago
- ☆53Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- The Energy Transformer block, in JAX☆58Updated last year
- Code for the paper "Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression"☆23Updated 2 years ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆53Updated last year
- ☆65Updated 3 years ago
- ☆33Updated last year
- ☆23Updated 9 months ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆40Updated 2 years ago
- ☆71Updated 10 months ago
- ☆23Updated 11 months ago
- ☆34Updated 2 years ago
- ☆53Updated last year
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 4 years ago
- ☆11Updated last year
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- ☆108Updated 8 months ago
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆19Updated 11 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆88Updated last year
- ☆11Updated last year
- Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]☆37Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆79Updated 3 years ago
- Sparse Autoencoder Training Library☆55Updated 5 months ago
- ☆58Updated last year
- Efficient empirical NTKs in PyTorch☆22Updated 3 years ago
- ☆70Updated 3 years ago
- ☆33Updated last year