Alternatives and similar repositories for trainit

Users that are interested in trainit are comparing it to the libraries listed below

• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆22Updated 7 months ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆40Updated 2 months ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 7 months ago
• Niccolo-Ajroldi / plainLM
  Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…
  ☆25Updated this week
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆177Updated 2 weeks ago
• team-approx-bayes / ivon
  IVON optimizer for neural networks based on variational learning.
  ☆68Updated 7 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• locuslab / edge-of-stability
  ☆68Updated 6 months ago
• andres-fr / skerch
  Sketched matrix decompositions for PyTorch
  ☆70Updated this week
• SaitejaUtpala / rieoptax
  Riemannian Optimization Using JAX
  ☆49Updated last year
• fKunstner / noise-sgd-adam-sign
  ☆16Updated 2 years ago
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated last year
• epfml / REQ
  ☆17Updated last year
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• nshepperd / gumbel-rao-pytorch
  ☆11Updated 3 years ago
• LIONS-EPFL / scion
  ☆21Updated 3 weeks ago
• jongharyu / neural-svd
  ☆16Updated 9 months ago
• alecwangcq / KFAC-Pytorch
  Pytorch implementation of KFAC and E-KFAC (Natural Gradient).
  ☆132Updated 5 years ago
• acerbilab / amortized-conditioning-engine
  Amortized Probabilistic Conditioning for Optimization, Simulation and Inference (Chang et al., AISTATS 2025)
  ☆16Updated 2 months ago
• AlexanderMath / fasth
  Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.
  ☆75Updated 11 months ago
• MarlonBecker / MSAM
  ☆19Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆87Updated this week
• ymalitsky / adaptive_GD
  Adaptive gradient descent without descent
  ☆48Updated 3 years ago
• joneswack / dp-rfs
  This repository contains PyTorch implementations of various random feature maps for dot product kernels.
  ☆21Updated 11 months ago
• PetrMokrov / Large-Scale-Wasserstein-Gradient-Flows
  Source code for Large-Scale Wasserstein Gradient Flows (NeurIPS 2021)
  ☆32Updated 3 years ago
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆41Updated 6 years ago
• modula-systems / modula
  🧱 Modula software package
  ☆200Updated 2 months ago
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆21Updated last year
• GallagherCommaJack / modulax
  ☆17Updated 10 months ago