mgrankin / minGPT
minGPT in JAX
☆48Updated 3 years ago
Alternatives and similar repositories for minGPT
Users that are interested in minGPT are comparing it to the libraries listed below
Sorting:
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆33Updated last year
- LoRA for arbitrary JAX models and functions☆136Updated last year
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- A JAX implementation of stochastic addition.☆14Updated 2 years ago
- JMP is a Mixed Precision library for JAX.☆198Updated 3 months ago
- A functional training loops library for JAX☆88Updated last year
- Scaling scaling laws with board games.☆48Updated last year
- A simple library for scaling up JAX programs☆134Updated 6 months ago
- This is a port of Mistral-7B model in JAX☆32Updated 10 months ago
- Turn jitted jax functions back into python source code☆22Updated 4 months ago
- ☆114Updated this week
- A metrics library for the JAX ecosystem☆40Updated 2 years ago
- If it quacks like a tensor...☆58Updated 6 months ago
- Autoregressive transformer in JAX from scratch☆22Updated 3 years ago
- Jax/Flax rewrite of Karpathy's nanoGPT☆57Updated 2 years ago
- Lightning-like training API for JAX with Flax☆38Updated 5 months ago
- ☆109Updated this week
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Updated last year
- Minimal but scalable implementation of large language models in JAX☆34Updated 6 months ago
- JAX Arrays for human consumption☆92Updated last year
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆44Updated 11 months ago
- ☆43Updated last month
- Visualize, create, and operate on pytrees in the most intuitive way possible.☆45Updated 4 months ago
- ☆60Updated 3 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆174Updated last week
- JAX Synergistic Memory Inspector☆173Updated 9 months ago
- Einsum-like high-level array sharding API for JAX☆34Updated 9 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆83Updated last year
- Implementation of PSGD optimizer in JAX☆33Updated 4 months ago