Alternatives and similar repositories for kauldron

Users that are interested in kauldron are comparing it to the libraries listed below

• google / qwix
  a Jax quantization library
  ☆80Updated last week
• AI-Hypercomputer / maxdiffusion
  ☆294Updated this week
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆97Updated 5 months ago
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆297Updated last year
• microsoft / dion
  Dion optimizer algorithm
  ☆413Updated this week
• apple / ml-pararnn
  ☆158Updated 2 months ago
• google-deepmind / nanodo
  ☆287Updated last year
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆39Updated last month
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆360Updated last week
• nebius / kvax
  A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.
  ☆155Updated last month
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆556Updated 2 weeks ago
• ESHyperscale / HyperscaleES
  Jax Codebase for Evolutionary Strategies at the Hyperscale
  ☆207Updated 2 weeks ago
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆306Updated last month
• jax-ml / jax-llm-examples
  Minimal yet performant LLM examples in pure JAX
  ☆225Updated this week
• erfanzar / EasyDeL
  Accelerate, Optimize performance with streamlined training and serving options with JAX.
  ☆328Updated this week
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆107Updated 5 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆322Updated 4 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆133Updated 3 weeks ago
• google / praxis
  ☆191Updated 3 weeks ago
• Noumena-Network / nmoe
  MoE training for Me and You and maybe other people
  ☆315Updated this week
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• NVIDIA / JAX-Toolbox
  JAX-Toolbox
  ☆373Updated this week
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆198Updated 2 weeks ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆70Updated last year
• NX-AI / xlstm-jax
  Official JAX implementation of xLSTM including fast and efficient training and inference code. 7B model available at https://huggingface.…
  ☆105Updated last year
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆55Updated 3 months ago
• google / torchax
  torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JA…
  ☆159Updated 2 weeks ago
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆198Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆109Updated 10 months ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆77Updated 3 months ago