Alternatives and similar repositories for cifar10-airbench:

Users that are interested in cifar10-airbench are comparing it to the libraries listed below

• HomebrewML / HeavyBall
  Efficient optimizers
  ☆183Updated 2 weeks ago
• modula-systems / modula
  🧱 Modula software package
  ☆173Updated 2 weeks ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆177Updated 7 months ago
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated 7 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆79Updated 3 months ago
• google-deepmind / nanodo
  ☆214Updated 8 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆162Updated 4 months ago
• nikhilvyas / SOAP
  ☆169Updated 3 months ago
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆276Updated this week
• fferflo / einx
  Universal Tensor Operations in Einstein-Inspired Notation for Python.
  ☆361Updated last month
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆214Updated 3 weeks ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…
  ☆169Updated 3 months ago
• cloneofsimo / min-fsdp
  ☆76Updated 8 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆498Updated this week
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆179Updated 6 months ago
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆370Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆100Updated 4 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆122Updated 11 months ago
• lucidrains / flash-attention-jax
  Implementation of Flash Attention in Jax
  ☆206Updated last year
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆475Updated last year
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆150Updated this week
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆269Updated 9 months ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆124Updated 3 months ago
• google-research / jaxpruner
  ☆220Updated last month
• KellerJordan / Muon
  Muon optimizer: +>30% sample efficiency with <3% wallclock overhead
  ☆505Updated last week
• apple / ml-sigma-reparam
  ☆301Updated 9 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆185Updated 2 weeks ago
• riverstone496 / awesome-second-order-optimization
  ☆25Updated last year