Alternatives and similar repositories for kauldron

Users that are interested in kauldron are comparing it to the libraries listed below

• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆293Updated last year
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆95Updated 2 months ago
• NVlabs / RLP
  RLP: Reinforcement as a Pretraining Objective
  ☆155Updated last week
• microsoft / dion
  Dion optimizer algorithm
  ☆361Updated last week
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆304Updated this week
• modula-systems / modula
  🧱 Modula software package
  ☆282Updated last month
• google-deepmind / nanodo
  ☆282Updated last year
• google-deepmind / mishax
  ☆142Updated last month
• AI-Hypercomputer / RecML
  ☆211Updated last week
• CLAIRE-Labo / EvoTune
  Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.
  ☆112Updated 2 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• iliao2345 / CompressARC
  ☆188Updated last month
• google / qwix
  a Jax quantization library
  ☆49Updated this week
• jax-ml / jax-llm-examples
  Minimal yet performant LLM examples in pure JAX
  ☆181Updated 2 weeks ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆147Updated last week
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 8 months ago
• nebius / kvax
  A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.
  ☆144Updated 6 months ago
• google-deepmind / regress-lm
  Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…
  ☆268Updated this week
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆539Updated this week
• epfml / DenseFormer
  ☆81Updated last year
• AI-Hypercomputer / maxdiffusion
  ☆264Updated this week
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆38Updated last month
• google / praxis
  ☆189Updated 2 weeks ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆192Updated 10 months ago
• NX-AI / xlstm-jax
  Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…
  ☆103Updated 9 months ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆296Updated last month
• imbue-ai / carbs
  Cost aware hyperparameter tuning algorithm
  ☆171Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆164Updated 3 months ago
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆292Updated last year
• NVlabs / gbrl
  Gradient Boosting Reinforcement Learning (GBRL)
  ☆120Updated last month