borjanG / 2023-transformers-rotf
Codes for the paper "A mathematical perspective on Transformers".
☆36Updated 8 months ago
Alternatives and similar repositories for 2023-transformers-rotf:
Users that are interested in 2023-transformers-rotf are comparing it to the libraries listed below
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆61Updated 9 months ago
- A State-Space Model with Rational Transfer Function Representation.☆78Updated 10 months ago
- ☆31Updated 11 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- ☆52Updated 5 months ago
- Pytorch-like dataloaders for JAX.☆77Updated 5 months ago
- An AI benchmark for creative, human-like problem solving using Sudoku variants☆29Updated last week
- The Energy Transformer block, in JAX☆56Updated last year
- Implementation of PSGD optimizer in JAX☆30Updated 2 months ago
- Open source code for EigenGame.☆30Updated last year
- Code for the book "The Elements of Differentiable Programming".☆77Updated last week
- ☆37Updated 2 years ago
- ☆30Updated 5 months ago
- ☆49Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆76Updated 2 years ago
- Brain-Inspired Modular Training (BIMT), a method for making neural networks more modular and interpretable.☆166Updated last year
- Flow-matching algorithms in JAX☆86Updated 7 months ago
- [ICLR'25] Artificial Kuramoto Oscillatory Neurons☆67Updated last month
- About A collection of AWESOME things about information geometry Topics☆156Updated 8 months ago
- symbolic regression☆39Updated 2 years ago
- Jax like function transformation engine but micro, microjax☆30Updated 5 months ago
- ☆87Updated 2 weeks ago
- Wraps PyTorch code in a JIT-compatible way for JAX. Supports automatically defining gradients for reverse-mode AutoDiff.☆48Updated last month
- Lightning-like training API for JAX with Flax☆38Updated 3 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆108Updated 3 months ago
- Codes for the paper The emergence of clusters in self-attention dynamics.☆15Updated last year
- Latent Program Network (from the "Searching Latent Program Spaces" paper)☆76Updated 2 weeks ago
- ☆112Updated last month
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆122Updated last year
- Scalable Convex Neural Networks☆23Updated this week