google / paxmlLinks
Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.
☆523Updated last week
Alternatives and similar repositories for paxml
Users that are interested in paxml are comparing it to the libraries listed below
Sorting:
- ☆187Updated last week
- ☆324Updated last week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆630Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆412Updated last month
- ☆142Updated last week
- JAX-Toolbox☆329Updated this week
- Orbax provides common checkpointing and persistence utilities for JAX users☆414Updated this week
- ☆361Updated last year
- ☆519Updated last year
- seqax = sequence modeling + JAX☆165Updated 2 weeks ago
- Library for reading and processing ML training data.☆494Updated this week
- ☆275Updated last year
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆365Updated 2 months ago
- JAX Synergistic Memory Inspector☆177Updated last year
- JAX implementation of the Llama 2 model☆219Updated last year
- Implementation of Flash Attention in Jax☆215Updated last year
- CLU lets you write beautiful training loops in JAX.☆351Updated last month
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆389Updated this week
- ☆351Updated this week
- Train very large language models in Jax.☆206Updated last year
- Inference code for LLaMA models in JAX☆118Updated last year
- Task-based datasets, preprocessing, and evaluation for sequence models.☆583Updated 2 weeks ago
- ☆232Updated 5 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆381Updated this week
- JMP is a Mixed Precision library for JAX.☆208Updated 6 months ago
- ☆22Updated last week
- ☆144Updated this week
- Everything you want to know about Google Cloud TPU☆538Updated last year
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆377Updated this week
- For optimization algorithm research and development.☆524Updated this week