Alternatives and similar repositories for MSAM

Users that are interested in MSAM are comparing it to the libraries listed below

• mueller-mp / SAM-ON
  ☆34Updated last year
• nblt / RWP
  ☆11Updated 2 years ago
• IlanPrice / DCTpS
  Code for testing DCT plus Sparse (DCTpS) networks
  ☆14Updated 3 years ago
• AngusDujw / SAF
  ☆35Updated 2 years ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆31Updated 7 months ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆28Updated last year
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 10 months ago
• sail-sg / win
  ☆9Updated last year
• LIONS-EPFL / scion
  ☆19Updated 2 months ago
• locuslab / edge-of-stability
  ☆67Updated 5 months ago
• dydjw9 / Efficient_SAM
  ☆58Updated 2 years ago
• VITA-Group / ToST
  [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang
  ☆28Updated 2 years ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆37Updated 2 years ago
• fKunstner / noise-sgd-adam-sign
  ☆16Updated 2 years ago
• Qualcomm-AI-research / llm-surgeon
  ☆29Updated last year
• tml-epfl / understanding-sam
  Towards Understanding Sharpness-Aware Minimization [ICML 2022]
  ☆35Updated 2 years ago
• nitarshan / robust-generalization-measures
  Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)
  ☆28Updated 4 years ago
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆26Updated 11 months ago
• gortizji / linearized-networks
  Source code of "What can linearized neural networks actually say about generalization?
  ☆20Updated 3 years ago
• mil-ad / prospr
  Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients
  ☆31Updated 3 years ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• JeanKaddour / WASAM
  Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)
  ☆28Updated 2 years ago
• locuslab / orthogonal-convolutions
  Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness
  ☆45Updated 4 years ago
• VITA-Group / Lifelong-Learning-LTH
  [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…
  ☆25Updated 3 years ago
• rollovd / LookSAM
  This is unofficial repository for Towards Efficient and Scalable Sharpness-Aware Minimization.
  ☆36Updated last year
• JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
  Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
  ☆40Updated 6 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• team-approx-bayes / bayesian-sam
  Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.
  ☆25Updated last year