GallagherCommaJack / modulaxLinks
☆17Updated 10 months ago
Alternatives and similar repositories for modulax
Users that are interested in modulax are comparing it to the libraries listed below
Sorting:
- Implementation of PSGD optimizer in JAX☆33Updated 5 months ago
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- Turn jitted jax functions back into python source code☆22Updated 6 months ago
- Maximal Update Parametrization (μP) with Flax & Optax.☆11Updated last year
- Schedule free optimiser implemented in JAX using Optimistix☆14Updated last year
- Minimal but scalable implementation of large language models in JAX☆35Updated 7 months ago
- If it quacks like a tensor...☆58Updated 7 months ago
- ☆53Updated 8 months ago
- ☆19Updated last month
- ☆32Updated last year
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆29Updated 4 years ago
- nanoGPT using Equinox☆13Updated 2 years ago
- Automatically take good care of your preemptible TPUs☆36Updated 2 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- The Energy Transformer block, in JAX☆58Updated last year
- ☆43Updated 3 weeks ago
- Einsum-like high-level array sharding API for JAX☆35Updated 11 months ago
- ☆60Updated 3 years ago
- ☆40Updated last year
- A simple library for scaling up JAX programs☆139Updated 7 months ago
- ☆27Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆33Updated last year
- ☆32Updated 8 months ago
- Jax/Flax rewrite of Karpathy's nanoGPT☆57Updated 2 years ago
- ☆13Updated last week
- ☆53Updated last year
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Updated 8 months ago
- NumPy+Jax with named axes and an uncompromising attitude☆20Updated 3 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated 2 weeks ago
- A simple hypernetwork implementation in jax using haiku.☆23Updated 2 years ago