Alternatives and similar repositories for trainit

Users that are interested in trainit are comparing it to the libraries listed below

• LIONS-EPFL / scion
  ☆33Updated last month
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆22Updated 9 months ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆179Updated 2 weeks ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆216Updated 2 weeks ago
• f-dangel / curvlinops
  PyTorch linear operators for curvature matrices (Hessian, Fisher/GGN, KFAC, ...)
  ☆40Updated 3 months ago
• team-approx-bayes / ivon
  IVON optimizer for neural networks based on variational learning.
  ☆70Updated 9 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• nikhilvyas / SOAP
  ☆206Updated 8 months ago
• andres-fr / skerch
  Sketched matrix decompositions for PyTorch
  ☆70Updated this week
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆188Updated 8 months ago
• wiseodd / pub-ready-plots
  Agustinus' very opiniated publication-ready plotting library
  ☆67Updated 3 months ago
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆94Updated 2 months ago
• Niccolo-Ajroldi / plainLM
  Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…
  ☆32Updated this week
• locuslab / edge-of-stability
  ☆70Updated 8 months ago
• shikaiqiu / compute-better-spent
  ☆53Updated 10 months ago
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 9 months ago
• f-dangel / vivit
  [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…
  ☆17Updated 2 years ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆140Updated last year
• alisiahkoohi / Langevin-dynamics
  Sampling with gradient-based Markov Chain Monte Carlo approaches
  ☆107Updated last year
• AndPotap / einsum-search
  ☆32Updated 10 months ago
• jax-ml / bonsai
  Minimal, lightweight JAX implementations of popular models.
  ☆79Updated this week
• fKunstner / noise-sgd-adam-sign
  ☆16Updated 2 years ago
• kvfrans / splus
  ☆115Updated 2 months ago
• bb515 / diffusionjax
  diffusionjax is a simple and accessible diffusion models package in JAX
  ☆47Updated 6 months ago
• phlippe / jax_trainer
  Lightning-like training API for JAX with Flax
  ☆42Updated 8 months ago
• nshepperd / gumbel-rao-pytorch
  ☆11Updated 4 years ago
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆16Updated last year
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• KellerJordan / top-sgd
  Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)
  ☆14Updated last year