borjanG / 2023-transformersLinks
Codes for the paper The emergence of clusters in self-attention dynamics.
☆16Updated last year
Alternatives and similar repositories for 2023-transformers
Users that are interested in 2023-transformers are comparing it to the libraries listed below
Sorting:
- ☆32Updated 8 months ago
- Supplementary code for the paper "Meta-Solver for Neural Ordinary Differential Equations" https://arxiv.org/abs/2103.08561☆25Updated 4 years ago
- ☆53Updated 8 months ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated 2 years ago
- Implementation of Action Matching for the Schrödinger equation☆24Updated 2 years ago
- ☆26Updated 2 years ago
- ☆32Updated last year
- Blog post☆17Updated last year
- Implementation of OpenAI's 'Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets' paper.☆37Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆124Updated last year
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆63Updated last year
- Euclidean Wasserstein-2 optimal transportation☆47Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions☆10Updated 7 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆16Updated 2 years ago
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆19Updated last month
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- Code for experiments on transformers using Markovian data.☆15Updated 7 months ago
- Transformers with doubly stochastic attention☆46Updated 2 years ago
- ☆35Updated 6 months ago
- Omnigrok: Grokking Beyond Algorithmic Data☆58Updated 2 years ago
- The Energy Transformer block, in JAX☆58Updated last year
- ☆23Updated 9 months ago
- ☆13Updated 3 years ago
- Implementation for our paper "How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad"☆11Updated last year
- ☆32Updated last year
- ☆15Updated 3 years ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆41Updated 6 years ago
- ☆22Updated 3 years ago