Alternatives and similar repositories for trainit

Users that are interested in trainit are comparing it to the libraries listed below

• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆191Updated last week
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆24Updated last year
• andres-fr / skerch
  Sketched linear operations for PyTorch
  ☆100Updated 2 months ago
• Niccolo-Ajroldi / plainLM
  Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…
  ☆42Updated last month
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• LIONS-EPFL / scion
  ☆52Updated last month
• kvfrans / splus
  ☆123Updated 7 months ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆62Updated this week
• nikhilvyas / SOAP
  ☆237Updated last year
• team-approx-bayes / ivon
  IVON optimizer for neural networks based on variational learning.
  ☆80Updated last year
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated 2 years ago
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆16Updated 2 years ago
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆98Updated last month
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆191Updated last year
• GallagherCommaJack / modulax
  ☆18Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆321Updated 5 months ago
• dlwh / jax_sourceror
  Turn jitted jax functions back into python source code
  ☆23Updated last year
• locuslab / edge-of-stability
  ☆73Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated last month
• apple / ml-ademamix
  ☆70Updated last year
• johnryan465 / pscan
  ☆40Updated 2 years ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆144Updated 2 months ago
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆35Updated last year
• acerbilab / amortized-conditioning-engine
  Amortized Probabilistic Conditioning for Optimization, Simulation and Inference (Chang et al., AISTATS 2025)
  ☆21Updated 6 months ago
• jax-ml / jax-llm-examples
  Minimal yet performant LLM examples in pure JAX
  ☆230Updated last week
• epfml / REQ
  ☆19Updated last year
• google-deepmind / kfac-jax
  Second Order Optimization and Curvature Estimation with K-FAC in JAX.
  ☆307Updated this week
• AndPotap / einsum-search
  ☆33Updated last year