google / paxml
Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.
☆480Updated 3 weeks ago
Alternatives and similar repositories for paxml:
Users that are interested in paxml are comparing it to the libraries listed below
- ☆182Updated last week
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆550Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆381Updated last month
- ☆135Updated this week
- Orbax provides common checkpointing and persistence utilities for JAX users☆340Updated this week
- JAX-Toolbox☆284Updated this week
- ☆286Updated last week
- ☆338Updated 10 months ago
- ☆392Updated 7 months ago
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆287Updated this week
- seqax = sequence modeling + JAX☆145Updated this week
- ☆212Updated 7 months ago
- Library for reading and processing ML training data.☆392Updated this week
- JAX implementation of the Llama 2 model☆216Updated last year
- CLU lets you write beautiful training loops in JAX.☆332Updated 3 weeks ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆515Updated last week
- Implementation of a Transformer, but completely in Triton☆259Updated 2 years ago
- JAX Synergistic Memory Inspector☆168Updated 7 months ago
- Inference code for LLaMA models in JAX☆115Updated 9 months ago
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆253Updated last week
- Pipeline Parallelism for PyTorch☆753Updated 6 months ago
- This repository contains the experimental PyTorch native float8 training UX☆221Updated 7 months ago
- JMP is a Mixed Precision library for JAX.☆192Updated last month
- Train very large language models in Jax.☆202Updated last year
- Task-based datasets, preprocessing, and evaluation for sequence models.☆569Updated this week
- A library to analyze PyTorch traces.☆340Updated last week
- ☆191Updated this week
- An open-source efficient deep learning framework/compiler, written in python.☆683Updated this week
- Named Tensors for Legible Deep Learning in JAX☆163Updated this week
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆367Updated this week