Alternatives and similar repositories for trainit:

Users that are interested in trainit are comparing it to the libraries listed below

• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆36Updated last week
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆21Updated 5 months ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 5 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆173Updated this week
• fKunstner / noise-sgd-adam-sign
  ☆16Updated last year
• acerbilab / amortized-conditioning-engine
  Amortized Probabilistic Conditioning for Optimization, Simulation and Inference (Chang et al., AISTATS 2025)
  ☆15Updated this week
• team-approx-bayes / ivon
  IVON optimizer for neural networks based on variational learning.
  ☆62Updated 5 months ago
• nshepperd / gumbel-rao-pytorch
  ☆10Updated 3 years ago
• locuslab / edge-of-stability
  ☆67Updated 4 months ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆75Updated 9 months ago
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆34Updated 5 months ago
• dlwh / jax_sourceror
  Turn jitted jax functions back into python source code
  ☆22Updated 4 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆123Updated last year
• SaitejaUtpala / rieoptax
  Riemannian Optimization Using JAX
  ☆48Updated last year
• epfml / REQ
  ☆17Updated 10 months ago
• cgarciae / nanoGPT-jax
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆33Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆188Updated 3 weeks ago
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆99Updated last year
• wiseodd / pub-ready-plots
  Agustinus' very opiniated publication-ready plotting library
  ☆64Updated 2 months ago
• shikaiqiu / compute-better-spent
  ☆52Updated 6 months ago
• PerformanceEstimation / PEPit
  PEPit is a package enabling computer-assisted worst-case analyses of first-order optimization methods.
  ☆86Updated 3 months ago
• GallagherCommaJack / modulax
  ☆17Updated 8 months ago
• akshayka / hessian_trace_estimation
  Hessian trace estimation using PyTorch and Hutch++
  ☆19Updated 4 years ago
• cooper-org / cooper
  A general-purpose, deep learning-first library for constrained optimization in PyTorch
  ☆115Updated 3 weeks ago
• fKunstner / limitations-empirical-fisher
  Limitations of the Empirical Fisher Approximation
  ☆47Updated last month
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆20Updated last year
• gehring / fax
  ☆80Updated 3 years ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆58Updated 5 months ago
• jax-ml / jax-llm-examples
  ☆102Updated this week