jax-ml / scaling-book
Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
☆224Updated this week
Alternatives and similar repositories for scaling-book:
Users that are interested in scaling-book are comparing it to the libraries listed below
- ☆87Updated 2 weeks ago
- ☆215Updated 8 months ago
- Named Tensors for Legible Deep Learning in JAX☆168Updated this week
- A simple library for scaling up JAX programs☆134Updated 4 months ago
- jax-triton contains integrations between JAX and OpenAI Triton☆387Updated 2 weeks ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆127Updated last year
- JAX-Toolbox☆292Updated this week
- ☆144Updated this week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆524Updated last month
- Orbax provides common checkpointing and persistence utilities for JAX users☆351Updated this week
- OpTree: Optimized PyTree Utilities☆173Updated this week
- 🧱 Modula software package☆176Updated this week
- Implementation of Diffusion Transformer (DiT) in JAX☆269Updated 9 months ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆561Updated this week
- seqax = sequence modeling + JAX☆150Updated last week
- Experiment of using Tangent to autodiff triton☆78Updated last year
- A library for unit scaling in PyTorch☆124Updated 4 months ago
- Accelerated First Order Parallel Associative Scan☆177Updated 7 months ago
- ☆412Updated 8 months ago
- ☆290Updated this week
- LoRA for arbitrary JAX models and functions☆135Updated last year
- Run PyTorch in JAX. 🤝☆232Updated last month
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆239Updated this week
- A stand-alone implementation of several NumPy dtype extensions used in machine learning.☆255Updated this week
- ☆192Updated this week
- JMP is a Mixed Precision library for JAX.☆193Updated 2 months ago
- ☆152Updated last year
- Universal Tensor Operations in Einstein-Inspired Notation for Python.☆361Updated last month
- Applied AI experiments and examples for PyTorch☆250Updated last week
- Cataloging released Triton kernels.☆212Updated 2 months ago