Alternatives and similar repositories for trainit

Users that are interested in trainit are comparing it to the libraries listed below

• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆183Updated 2 weeks ago
• LIONS-EPFL / scion
  ☆40Updated last month
• f-dangel / singd
  [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)
  ☆23Updated 11 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆16Updated last year
• GallagherCommaJack / modulax
  ☆17Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• Niccolo-Ajroldi / plainLM
  Minimal pretraining script for language modeling in PyTorch. Supporting torch compilation and DDP. It includes a model implementation and…
  ☆33Updated last month
• kvfrans / splus
  ☆120Updated 4 months ago
• shikaiqiu / compute-better-spent
  ☆58Updated last year
• davisyoshida / qax
  If it quacks like a tensor...
  ☆59Updated 10 months ago
• BirkhoffG / jax-dataloader
  Pytorch-like dataloaders for JAX.
  ☆93Updated 4 months ago
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆190Updated 10 months ago
• johnryan465 / pscan
  ☆39Updated last year
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆14Updated 11 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆282Updated last month
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆143Updated 11 months ago
• nikhilvyas / SOAP
  ☆216Updated 10 months ago
• MarlonBecker / MSAM
  ☆19Updated last year
• AndPotap / einsum-search
  ☆33Updated last year
• team-approx-bayes / ivon
  IVON optimizer for neural networks based on variational learning.
  ☆72Updated 11 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated last month
• NicolasZucchet / minimal-LRU
  Non official implementation of the Linear Recurrent Unit (LRU, Orvieto et al. 2023)
  ☆57Updated last month
• jax-ml / bonsai
  Minimal, lightweight JAX implementations of popular models.
  ☆110Updated this week
• edwardmilsom / function-space-learning-rates-paper
  Code for the paper "Function-Space Learning Rates"
  ☆23Updated 4 months ago
• evanatyourservice / psgd_jax
  Implementation of PSGD optimizer in JAX
  ☆33Updated 9 months ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆141Updated last year
• andres-fr / skerch
  Sketched linear operations for PyTorch
  ☆71Updated this week
• apple / ml-ademamix
  ☆67Updated 10 months ago
• paganpasta / eqxvision
  A Python package of computer vision models for the Equinox ecosystem.
  ☆108Updated last year