Alternatives and similar repositories for win

Users that are interested in win are comparing it to the libraries listed below

• zqOuO / GWT
  ☆13Updated 4 months ago
• LIONS-EPFL / scion
  ☆19Updated 2 months ago
• TianjinYellow / SPAM-Optimizer
  ☆32Updated 2 months ago
• MarlonBecker / MSAM
  ☆19Updated last year
• AngusDujw / SAF
  ☆35Updated 2 years ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• nblt / RWP
  ☆11Updated 2 years ago
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆14Updated 10 months ago
• VijayLingam95 / SVFT
  ☆28Updated 3 months ago
• nblt / F-SAM
  [CVPR 2024] Friendly Sharpness-Aware Minimization
  ☆33Updated 7 months ago
• dayal-kalra / low-memory-adam
  ☆12Updated 3 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆31Updated 7 months ago
• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆35Updated 3 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 8 months ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 2 months ago
• Itamarzimm / UnifiedImplicitAttnRepr
  [ICLR 2025] Official Code Release for Explaining Modern Gated-Linear RNNs via a Unified Implicit Attention Formulation
  ☆42Updated 3 months ago
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆28Updated last month
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆28Updated last year
• OpenNLPLab / HGRN
  [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…
  ☆64Updated last year
• berlino / seq_icl
  ☆52Updated last year
• wjxts / RegularizedBN
  ☆21Updated 2 years ago
• devansh20la / LPF-SGD
  ☆17Updated 2 years ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆16Updated 7 months ago
• epfml / REQ
  ☆17Updated 11 months ago
• amazon-science / mezo_svrg
  Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"
  ☆11Updated 11 months ago
• berlino / gated_linear_attention
  ☆103Updated last year
• themrzmaster / git-re-basin-pytorch
  Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch
  ☆75Updated 2 years ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆79Updated 5 months ago
• aim-uofa / LoRAPrune
  ☆54Updated 5 months ago