GallagherCommaJack / modulax
☆16Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for modulax
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- Implementation of PSGD optimizer in JAX☆17Updated last week
- ☆36Updated 10 months ago
- ☆46Updated last month
- Scalable neural net training via automatic normalization in the modular norm.☆121Updated 3 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆127Updated last month
- ☆18Updated last month
- If it quacks like a tensor...☆52Updated last week
- Pytorch-like dataloaders in JAX.☆59Updated last month
- ☆53Updated 10 months ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆16Updated this week
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆79Updated 9 months ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Updated last month
- ☆58Updated 2 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- Automatically take good care of your preemptible TPUs☆32Updated last year
- Simple Scalable Discrete Diffusion for text in PyTorch☆28Updated last month
- ☆50Updated 6 months ago
- LoRA for arbitrary JAX models and functions☆132Updated 8 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆57Updated last year
- A State-Space Model with Rational Transfer Function Representation.☆70Updated 6 months ago
- A functional training loops library for JAX☆85Updated 9 months ago
- ☆128Updated this week
- Sequence Modeling with Structured State Spaces☆60Updated 2 years ago
- The Energy Transformer block, in JAX☆53Updated 11 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆95Updated 6 months ago
- ☆40Updated 4 months ago
- Transformers with doubly stochastic attention☆40Updated 2 years ago
- A simple hypernetwork implementation in jax using haiku.☆23Updated 2 years ago