mgrankin / minGPTLinks
minGPT in JAX
☆48Updated 3 years ago
Alternatives and similar repositories for minGPT
Users that are interested in minGPT are comparing it to the libraries listed below
Sorting:
- LoRA for arbitrary JAX models and functions☆143Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆37Updated 2 years ago
- A functional training loops library for JAX☆88Updated last year
- A simple library for scaling up JAX programs☆144Updated last month
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆188Updated this week
- JMP is a Mixed Precision library for JAX.☆210Updated 11 months ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆92Updated last year
- If it quacks like a tensor...☆59Updated last year
- Jax/Flax rewrite of Karpathy's nanoGPT☆62Updated 2 years ago
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆81Updated 3 years ago
- ☆118Updated 2 weeks ago
- ☆63Updated 3 years ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆74Updated 5 months ago
- Train very large language models in Jax.☆210Updated 2 years ago
- A port of muP to JAX/Haiku☆25Updated 3 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 3 years ago
- Fast Discounted Cumulative Sums in PyTorch☆96Updated 4 years ago
- JAX Synergistic Memory Inspector☆183Updated last year
- Scaling scaling laws with board games.☆54Updated 2 years ago
- Serialize JAX, Flax, Haiku, or Objax model params with 🤗`safetensors`☆47Updated last year
- Running Jax in PyTorch Lightning☆117Updated last year
- Use Jax functions in Pytorch☆259Updated 2 years ago
- ☆162Updated 2 years ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- ☆53Updated last year
- Meta-learning inductive biases in the form of useful conserved quantities.☆39Updated 3 years ago
- ☆60Updated 3 years ago
- ☆71Updated 2 years ago
- A selection of neural network models ported from torchvision for JAX & Flax.☆45Updated 5 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago