Alternatives and similar repositories for plainLM

Users that are interested in plainLM are comparing it to the libraries listed below

• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆179Updated this week
• shikaiqiu / compute-better-spent
  ☆57Updated 11 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆84Updated 8 months ago
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆288Updated last month
• nikhilvyas / SOAP
  ☆207Updated 9 months ago
• modula-systems / modula
  🧱 Modula software package
  ☆231Updated 2 weeks ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆103Updated 3 months ago
• LIONS-EPFL / scion
  ☆36Updated 3 weeks ago
• google-research / jaxpruner
  ☆233Updated 6 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆187Updated last year
• google-deepmind / nanodo
  ☆277Updated last year
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆259Updated last month
• locuslab / edge-of-stability
  ☆70Updated 8 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆156Updated 2 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆127Updated 8 months ago
• wtong98 / mlp-icl
  ☆11Updated 11 months ago
• berlino / seq_icl
  ☆53Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆89Updated last week
• kvfrans / splus
  ☆116Updated 2 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆166Updated last month
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆130Updated last month
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated 2 years ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆57Updated last week
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆391Updated last week
• cloneofsimo / min-fsdp
  ☆87Updated last year
• johnryan465 / pscan
  ☆40Updated last year
• dmis-lab / Outlier-Safe-Pre-Training
  [ACL 2025] Outlier-Safe Pre-Training for Robust 4-Bit Quantization of Large Language Models
  ☆29Updated last month
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆142Updated last year
• orobix / fwdgrad
  Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
  ☆111Updated 2 years ago