Alternatives and similar repositories for plainLM

Users that are interested in plainLM are comparing it to the libraries listed below

• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆179Updated last month
• ZQZCalin / trainit
  ☆10Updated 2 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆204Updated 3 months ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆100Updated 2 months ago
• nikhilvyas / SOAP
  ☆197Updated 7 months ago
• shikaiqiu / compute-better-spent
  ☆53Updated 9 months ago
• epfml / REQ
  ☆17Updated last year
• google-research / jaxpruner
  ☆230Updated 5 months ago
• LIONS-EPFL / scion
  ☆26Updated 2 weeks ago
• NicolasZucchet / Online-learning-LR-dependencies
  Implementation of the "Online learning of long-range dependencies" paper, NeurIPS 2023
  ☆18Updated 8 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆82Updated 7 months ago
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• locuslab / edge-of-stability
  ☆70Updated 7 months ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆62Updated 4 years ago
• kazukiosawa / asdl
  ASDL: Automatic Second-order Differentiation Library for PyTorch
  ☆188Updated 7 months ago
• berlino / seq_icl
  ☆53Updated last year
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated last week
• google-deepmind / nanodo
  ☆273Updated last year
• KellerJordan / top-sgd
  Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)
  ☆14Updated last year
• johnryan465 / pscan
  ☆40Updated last year
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆125Updated this week
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆182Updated 10 months ago
• jenkspt / gpt-jax
  Jax/Flax rewrite of Karpathy's nanoGPT
  ☆59Updated 2 years ago
• wiseodd / pub-ready-plots
  Agustinus' very opiniated publication-ready plotting library
  ☆67Updated 2 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆84Updated last year
• JesseFarebro / flax-mup
  Maximal Update Parametrization (μP) with Flax & Optax.
  ☆11Updated last year
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆140Updated last year
• AllanYangZhou / universal_neural_functional
  ☆51Updated last year
• google-deepmind / eigengame
  Open source code for EigenGame.
  ☆30Updated 2 years ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated last year