google-research / kauldronLinks
Modular, scalable library to train ML models
☆135Updated last week
Alternatives and similar repositories for kauldron
Users that are interested in kauldron are comparing it to the libraries listed below
Sorting:
- A simple library for scaling up JAX programs☆139Updated 8 months ago
- A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.☆291Updated 10 months ago
- Scalable and Performant Data Loading☆288Updated this week
- ☆135Updated this week
- ☆81Updated last year
- Cost aware hyperparameter tuning algorithm☆162Updated last year
- ☆274Updated last year
- Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…☆91Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆147Updated 3 weeks ago
- JAX Implementation of Black Forest Labs' Flux.1 family of models☆34Updated 8 months ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆103Updated this week
- An implementation of PSGD Kron second-order optimizer for PyTorch☆92Updated 3 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆140Updated last month
- 🧱 Modula software package☆207Updated 3 months ago
- ☆114Updated last week
- A set of Python scripts that makes your experience on TPU better☆55Updated last year
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆31Updated last month
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆129Updated last year
- Simple & Scalable Pretraining for Neural Architecture Research☆110Updated this week
- ☆134Updated 3 months ago
- Gradient Boosting Reinforcement Learning (GBRL)☆116Updated last month
- ☆304Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆84Updated last year
- A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.☆128Updated 3 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆124Updated 11 months ago
- For optimization algorithm research and development.☆521Updated this week
- Automatically take good care of your preemptible TPUs☆36Updated 2 years ago
- PyTorch Single Controller☆325Updated this week
- JAX-Toolbox☆323Updated this week
- ☆230Updated this week