Alternatives and similar repositories for pytorch-lamb

Users that are interested in pytorch-lamb are comparing it to the libraries listed below

• NUS-HPC-AI-Lab / LARS-ImageNet-PyTorch
  Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional acc…
  ☆38Updated 4 years ago
• pipilurj / BONAS
  ☆35Updated 3 years ago
• jianweif / OptimalGradCheckpointing
  ☆41Updated 4 years ago
• VITA-Group / SMC-Bench
  [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…
  ☆28Updated last year
• LiuXiaoxuanPKU / GACT-ICML
  ☆42Updated 2 years ago
• JingtongSu / sanity-checking-pruning
  Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot
  ☆42Updated 4 years ago
• IST-DASLab / WoodFisher
  Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)
  ☆52Updated 4 years ago
• varunnair18 / FISH
  Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).
  ☆58Updated 3 years ago
• alecwangcq / GraSP
  Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH
  ☆105Updated 5 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆80Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 3 years ago
• yxli2123 / LoSparse
  ☆57Updated last year
• automl / nas-bench-x11
  ☆19Updated 3 years ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆20Updated 3 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• juntang-zhuang / GSAM
  PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)
  ☆143Updated 2 years ago
• IST-DASLab / M-FAC
  Efficient reference implementations of the static & dynamic M-FAC algorithms (for pruning and optimization)
  ☆17Updated 3 years ago
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 3 years ago
• JonasGeiping / fullbatchtraining
  Training vision models with full-batch gradient descent and regularization
  ☆37Updated 2 years ago
• x-zho14 / ProbMask-official
  Implementation of Effective Sparsification of Neural Networks with Global Sparsity Constraint
  ☆31Updated 3 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆87Updated 2 weeks ago
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆45Updated 2 years ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆88Updated 5 months ago
• yuezhouhu / 2by4-pretrain
  Efficient 2:4 sparse training algorithms and implementations
  ☆54Updated 6 months ago
• leeyeehoo / GenNAS
  Generic Neural Architecture Search via Regression (NeurIPS'21 Spotlight)
  ☆36Updated 2 years ago
• epfml / powersgd
  Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727
  ☆147Updated 7 months ago
• inspire-group / hydra
  Code and checkpoints of compressed networks for the paper titled "HYDRA: Pruning Adversarially Robust Neural Networks" (NeurIPS 2020) (ht…
  ☆92Updated 2 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 3 months ago
• LeapLabTHU / Deep-Incubation
  Code release for Deep Incubation (https://arxiv.org/abs/2212.04129)
  ☆90Updated 2 years ago
• DS3Lab / AC-SGD
  Code associated with the paper **Fine-tuning Language Models over Slow Networks using Activation Compression with Guarantees**.
  ☆28Updated 2 years ago