Alternatives and similar repositories for pytorch-lamb

Users that are interested in pytorch-lamb are comparing it to the libraries listed below

• NUS-HPC-AI-Lab / LARS-ImageNet-PyTorch
  Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional acc…
  ☆38Updated 4 years ago
• HazyResearch / fly
  ☆218Updated 2 years ago
• pipilurj / BONAS
  ☆35Updated 4 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆59Updated 3 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆64Updated 7 months ago
• allenai / hidden-networks
  ☆193Updated 4 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆53Updated 4 years ago
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆148Updated 11 months ago
• hushon / JAX-ResNet-CIFAR10
  Simple CIFAR10 ResNet example with JAX.
  ☆23Updated 4 years ago
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆41Updated 4 years ago
• alecwangcq / GraSP
  Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH
  ☆105Updated 5 years ago
• libffcv / ffcv-imagenet
  Train ImageNet *fast* in 500 lines of code with FFCV
  ☆149Updated last year
• JonasGeiping / fullbatchtraining
  Training vision models with full-batch gradient descent and regularization
  ☆38Updated 2 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 3 years ago
• MingSun-Tse / Awesome-Pruning-at-Initialization
  [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.
  ☆59Updated 2 years ago
• LiuXiaoxuanPKU / GACT-ICML
  ☆42Updated 2 years ago
• juntang-zhuang / GSAM
  PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)
  ☆144Updated 3 years ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated 2 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆199Updated 2 years ago
• D-X-Y / NATS-Bench
  TPAMI 2021: NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size
  ☆183Updated 3 years ago
• RAIVNLab / STR
  Soft Threshold Weight Reparameterization for Learnable Sparsity
  ☆90Updated 2 years ago
• verbiiyo / rigl-torch
  Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.
  ☆58Updated 3 years ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 5 months ago
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆28Updated 2 years ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆630Updated 2 months ago
• yueb17 / DLTH
  ☆32Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated 2 years ago
• automl / nas-bench-x11
  ☆19Updated 3 years ago
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 3 years ago
• ganguli-lab / Synaptic-Flow
  ☆227Updated last year