rahul13ramesh / compositional_capabilitiesLinks
Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks
☆10Updated last year
Alternatives and similar repositories for compositional_capabilities
Users that are interested in compositional_capabilities are comparing it to the libraries listed below
Sorting:
- Scaling scaling laws with board games.☆49Updated 2 years ago
- Code for minimum-entropy coupling.☆32Updated last year
- Official code for the paper "Compositional Generalization from First Principles" (NeurIPS 2023)☆11Updated last year
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆37Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆59Updated 3 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- Codebase for Mechanistic Mode Connectivity☆15Updated 2 years ago
- Experiments for Meta-Learning Symmetries by Reparameterization☆56Updated 4 years ago
- ☆18Updated 2 years ago
- ☆54Updated 11 months ago
- ☆24Updated 6 years ago
- ☆20Updated last year
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- A centralized place for deep thinking code and experiments☆85Updated last year
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆179Updated last month
- ☆31Updated 2 years ago
- Code for "Meta Learning Backpropagation And Improving It" @ NeurIPS 2021 https://arxiv.org/abs/2012.14905☆33Updated 3 years ago
- ☆20Updated 3 years ago
- ☆63Updated last year
- ☆11Updated last year
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆71Updated 2 weeks ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆84Updated last year
- ☆51Updated last year
- ☆26Updated 2 years ago
- PyTorch implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆37Updated 3 years ago
- Tensorflow implementation and notebooks for Implicit Maximum Likelihood Estimation☆67Updated 3 years ago
- ☆32Updated 9 months ago
- Code associated with our paper "Learning Group Structure and Disentangled Representations of Dynamical Environments"☆15Updated 2 years ago