google-research / kauldronLinks
Modular, scalable library to train ML models
☆170Updated this week
Alternatives and similar repositories for kauldron
Users that are interested in kauldron are comparing it to the libraries listed below
Sorting:
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆297Updated last year
- An implementation of PSGD Kron second-order optimizer for PyTorch☆97Updated 3 months ago
- Dion optimizer algorithm☆384Updated this week
- ☆82Updated last year
- a Jax quantization library☆62Updated this week
- Cost aware hyperparameter tuning algorithm☆173Updated last year
- Minimal yet performant LLM examples in pure JAX☆199Updated 2 months ago
- Scalable and Performant Data Loading☆335Updated this week
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…☆104Updated 10 months ago
- ☆285Updated last year
- Attention Kernels for Symmetric Power Transformers☆128Updated last month
- ☆190Updated 3 weeks ago
- 🧱 Modula software package☆303Updated 3 months ago
- ☆277Updated this week
- ☆119Updated 5 months ago
- Implementation of Diffusion Transformer (DiT) in JAX☆296Updated last year
- For optimization algorithm research and development.☆547Updated this week
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆147Updated last month
- Accelerate, Optimize performance with streamlined training and serving options with JAX.☆321Updated this week
- PyTorch implementation of models from the Zamba2 series.☆185Updated 10 months ago
- ☆143Updated 2 months ago
- A simple library for scaling up JAX programs☆144Updated 2 weeks ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆119Updated 3 weeks ago
- Simple & Scalable Pretraining for Neural Architecture Research☆300Updated 3 weeks ago
- Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…☆290Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆173Updated 4 months ago
- A set of Python scripts that makes your experience on TPU better☆54Updated 2 months ago
- torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JA…☆128Updated this week
- ☆117Updated 2 weeks ago