mgrankin / minGPT
minGPT in JAX
☆47Updated 3 years ago
Alternatives and similar repositories for minGPT:
Users that are interested in minGPT are comparing it to the libraries listed below
- LoRA for arbitrary JAX models and functions☆135Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆32Updated last year
- A simple library for scaling up JAX programs☆134Updated 4 months ago
- If it quacks like a tensor...☆57Updated 4 months ago
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆44Updated 9 months ago
- A functional training loops library for JAX☆86Updated last year
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- A JAX implementation of stochastic addition.☆14Updated 2 years ago
- ☆87Updated last week
- JAX Arrays for human consumption☆90Updated last year
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆170Updated 3 months ago
- Turn jitted jax functions back into python source code☆22Updated 3 months ago
- JMP is a Mixed Precision library for JAX.☆193Updated last month
- Jax/Flax rewrite of Karpathy's nanoGPT☆57Updated 2 years ago
- A metrics library for the JAX ecosystem☆40Updated 2 years ago
- Implementation of PSGD optimizer in JAX☆29Updated 2 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- This is a port of Mistral-7B model in JAX☆32Updated 8 months ago
- The 2D discrete wavelet transform for JAX☆41Updated 2 years ago
- ☆16Updated 7 months ago
- ☆112Updated last month
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 3 years ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆87Updated 9 months ago
- A selection of neural network models ported from torchvision for JAX & Flax.☆44Updated 4 years ago
- Automatically take good care of your preemptible TPUs☆36Updated last year
- ☆52Updated 5 months ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆48Updated last year
- Scaling scaling laws with board games.☆48Updated last year
- Lightning-like training API for JAX with Flax☆38Updated 3 months ago
- Visualize, create, and operate on pytrees in the most intuitive way possible.☆44Updated 2 months ago