google / tunixLinks
A JAX-native LLM Post-Training Library
☆128Updated this week
Alternatives and similar repositories for tunix
Users that are interested in tunix are comparing it to the libraries listed below
Sorting:
- Minimal yet performant LLM examples in pure JAX☆150Updated last week
- seqax = sequence modeling + JAX☆166Updated last month
- A simple library for scaling up JAX programs☆143Updated 10 months ago
- PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"☆70Updated 5 months ago
- Understand and test language model architectures on synthetic tasks.☆222Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆156Updated 2 months ago
- A set of Python scripts that makes your experience on TPU better☆54Updated last year
- ☆275Updated last year
- PyTorch Single Controller☆374Updated this week
- ☆87Updated last year
- Experiment of using Tangent to autodiff triton☆80Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆127Updated 8 months ago
- 🧱 Modula software package☆231Updated 2 weeks ago
- Inference code for LLaMA models in JAX☆118Updated last year
- JAX bindings for Flash Attention v2☆90Updated 2 weeks ago
- ☆188Updated this week
- Load compute kernels from the Hub☆258Updated last week
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆140Updated 4 months ago
- Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*☆87Updated last year
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆304Updated last week
- Minimal but scalable implementation of large language models in JAX☆35Updated this week
- JAX implementation of the Llama 2 model☆219Updated last year
- Train very large language models in Jax.☆208Updated last year
- Machine Learning eXperiment Utilities☆46Updated last month
- some common Huggingface transformers in maximal update parametrization (µP)☆82Updated 3 years ago
- Accelerated First Order Parallel Associative Scan☆187Updated last year
- ☆118Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆129Updated 9 months ago
- A library for unit scaling in PyTorch☆130Updated last month
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆25Updated 6 months ago