NTT123 / pax
A stateful pytree library for training neural networks.
☆21Updated 2 years ago
Alternatives and similar repositories for pax:
Users that are interested in pax are comparing it to the libraries listed below
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 4 years ago
- AdaCat☆49Updated 2 years ago
- Image augmentation library for Jax☆37Updated 9 months ago
- ☆63Updated 5 months ago
- Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'☆38Updated 3 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆47Updated last year
- A framework for implementing equivariant DL☆10Updated 3 years ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆47Updated 3 years ago
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- ☆30Updated this week
- ☆22Updated 2 years ago
- AdamW optimizer for bfloat16 models in pytorch 🔥.☆31Updated 7 months ago
- ☆24Updated 5 years ago
- Flax (JAX) implementation of Progressive Growing of GANs for Improved Quality, Stability, and Variation☆12Updated 3 years ago
- A home for audio ML in JAX. Has common features, learnable frontends, pretrained supervised and self-supervised models.☆65Updated 2 years ago
- Local Attention - Flax module for Jax☆20Updated 3 years ago
- PyTorch interface for TrueGrad Optimizers☆41Updated last year
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆43Updated 8 months ago
- ☆26Updated 2 years ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- If it quacks like a tensor...☆55Updated 2 months ago
- ☆38Updated 2 years ago
- Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"☆26Updated 4 years ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆30Updated last month
- A generative modelling toolkit for PyTorch.☆70Updated 3 years ago
- Tensor Parallelism with JAX + Shard Map☆11Updated last year
- The 2D discrete wavelet transform for JAX☆40Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorch☆29Updated 3 weeks ago