young-geng / scalax
A simple library for scaling up JAX programs
☆129Updated 2 months ago
Alternatives and similar repositories for scalax:
Users that are interested in scalax are comparing it to the libraries listed below
- LoRA for arbitrary JAX models and functions☆135Updated 10 months ago
- If it quacks like a tensor...☆55Updated 2 months ago
- JAX Synergistic Memory Inspector☆164Updated 6 months ago
- seqax = sequence modeling + JAX☆136Updated 6 months ago
- JMP is a Mixed Precision library for JAX.☆189Updated last month
- ☆201Updated 6 months ago
- Run PyTorch in JAX. 🤝☆214Updated last week
- Minimal but scalable implementation of large language models in JAX☆28Updated 2 months ago
- Named Tensors for Legible Deep Learning in JAX☆157Updated last week
- Experiment of using Tangent to autodiff triton☆74Updated 11 months ago
- ☆215Updated 8 months ago
- 🧱 Modula software package☆132Updated this week
- Pytorch-like dataloaders in JAX.☆67Updated 2 months ago
- Jax/Flax rewrite of Karpathy's nanoGPT☆54Updated last year
- ☆75Updated 6 months ago
- A library for unit scaling in PyTorch☆118Updated last month
- Train very large language models in Jax.☆198Updated last year
- OpTree: Optimized PyTree Utilities☆163Updated this week
- JAX bindings for Flash Attention v2☆83Updated 6 months ago
- JAX Arrays for human consumption☆90Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆121Updated 9 months ago
- Implementation of PSGD optimizer in JAX☆26Updated 2 weeks ago
- Turn jitted jax functions back into python source code☆22Updated last month
- ☆110Updated last week
- ☆106Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆363Updated this week
- A MAD laboratory to improve AI architecture designs 🧪☆102Updated last month
- Einsum-like high-level array sharding API for JAX☆33Updated 6 months ago
- A set of Python scripts that makes your experience on TPU better☆44Updated 6 months ago