Alternatives and similar repositories for plainLM

Users that are interested in plainLM are comparing it to the libraries listed below

• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆183Updated 2 weeks ago
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆107Updated 4 months ago
• shikaiqiu / compute-better-spent
  ☆58Updated last year
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆83Updated 10 months ago
• LIONS-EPFL / scion
  ☆40Updated last month
• google-research / jaxpruner
  ☆233Updated 7 months ago
• nikhilvyas / SOAP
  ☆216Updated 10 months ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆130Updated 2 months ago
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆303Updated 2 months ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆190Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆282Updated last month
• google-deepmind / nanodo
  ☆282Updated last year
• CLAIRE-Labo / StructuredFFN
  The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
  ☆19Updated last year
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆399Updated last week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆81Updated last year
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆35Updated 3 years ago
• cloneofsimo / min-fsdp
  ☆91Updated last year
• epfml / REQ
  ☆17Updated last year
• bremen79 / parameterfree
  Parameter-Free Optimizers for Pytorch
  ☆130Updated last year
• wtong98 / mlp-icl
  ☆11Updated last year
• berlino / seq_icl
  ☆53Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆164Updated 3 months ago
• locuslab / edge-of-stability
  ☆70Updated 10 months ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆62Updated last week
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆63Updated 6 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆129Updated 9 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆167Updated 2 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆35Updated last month
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆265Updated last week
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆31Updated 2 years ago