Alternatives and similar repositories for win

Users that are interested in win are comparing it to the libraries listed below

• zqOuO / GWT
  ☆13Updated 5 months ago
• lzhangbv / eva
  [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation
  ☆12Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆33Updated 3 months ago
• LIONS-EPFL / scion
  ☆21Updated 3 weeks ago
• MarlonBecker / MSAM
  ☆19Updated last year
• AngusDujw / SAF
  ☆36Updated 2 years ago
• dayal-kalra / low-memory-adam
  ☆12Updated 3 months ago
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆31Updated 7 months ago
• nblt / F-SAM
  [CVPR 2024] Friendly Sharpness-Aware Minimization
  ☆33Updated 7 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 7 months ago
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆55Updated last year
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆108Updated last month
• tml-epfl / sam-low-rank-features
  Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]
  ☆28Updated last year
• VijayLingam95 / SVFT
  ☆29Updated 4 months ago
• nblt / RWP
  ☆11Updated 2 years ago
• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆59Updated 3 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆73Updated last year
• devansh20la / LPF-SGD
  ☆17Updated 2 years ago
• Leiay / looped_transformer
  ☆28Updated last year
• cjyaras / deep-lora-transformers
  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)
  ☆13Updated 11 months ago
• shikaiqiu / compute-better-spent
  ☆53Updated 8 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 9 months ago
• aim-uofa / LoRAPrune
  ☆55Updated 6 months ago
• MohammadrezaBanaei / LoRA-XS
  LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
  ☆35Updated 3 months ago
• amazon-science / mezo_svrg
  Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"
  ☆11Updated last year
• Qualcomm-AI-research / llm-surgeon
  ☆30Updated last year
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆46Updated 10 months ago
• MaximeRobeyns / bayesian_lora
  Bayesian Low-Rank Adaptation for Large Language Models
  ☆34Updated last year
• dydjw9 / Efficient_SAM
  ☆58Updated 2 years ago
• epfml / REQ
  ☆17Updated last year