Alternatives and similar repositories for edge-of-stability

Users that are interested in edge-of-stability are comparing it to the libraries listed below

• tding1 / Neural-Collapse

  View on GitHub
  [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features
  ☆61Jul 19, 2022Updated 3 years ago
• abietti / transformer-birth

  View on GitHub
  ☆19Dec 12, 2023Updated 2 years ago
• aw31 / empirical-ntks

  View on GitHub
  Efficient empirical NTKs in PyTorch
  ☆22Jun 13, 2022Updated 3 years ago
• MinghuiChen43 / awesome-deep-phenomena

  View on GitHub
  A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...
  ☆390Jan 7, 2026Updated last month
• GuoTianYu2000 / Active-Dormant-Attention

  View on GitHub
  codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"
  ☆10Dec 30, 2024Updated last year
• sowmaster / esjacobians

  View on GitHub
  Implementations of the algorithms described in the paper: On the Convergence Theory for Hessian-Free Bilevel Algorithms.
  ☆10Nov 1, 2024Updated last year
• HanseulJo / position-coupling

  View on GitHub
  Position Coupling: Improving Length Generalization of Arithmetic Transformers Using Task Structure (NeurIPS 2024) + Arithmetic Transfor…
  ☆14Oct 26, 2025Updated 3 months ago
• Thinklab-SJTU / BiLAF

  View on GitHub
  Official implementation of Our NeurIPS 2024 Paper "Boundary Matters: A Bi-Level Active Finetuning Method"
  ☆14Feb 11, 2025Updated last year
• zhqwqwq / Learning-Parity-with-CoT

  View on GitHub
  [ICLR 2025] This repository contains the code to reproduce the results from our paper From Sparse Dependence to Sparse Attention: Unveili…
  ☆12Mar 7, 2025Updated 11 months ago
• imagination-research / LCSC

  View on GitHub
  [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better
  ☆16Feb 15, 2025Updated last year
• zzp1012 / SAM-in-Late-Phase

  View on GitHub
  [ICLR 2025 Spotlight] Code release for "Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training"
  ☆18Feb 20, 2025Updated 11 months ago
• riverstone496 / awesome-second-order-optimization

  View on GitHub
  ☆28Sep 30, 2025Updated 4 months ago
• mueller-mp / SAM-ON

  View on GitHub
  ☆34Jan 25, 2024Updated 2 years ago
• allenbai01 / transformers-as-statisticians

  View on GitHub
  ☆35Jul 5, 2023Updated 2 years ago
• xmed-lab / UniEval

  View on GitHub
  UniEval: Unified Holistic Evaluation for Unified Multimodal Understanding and Generation
  ☆22May 16, 2025Updated 9 months ago
• AlexandraVolokhova / stochasticity_in_neural_ode

  View on GitHub
  "Stochasticity in Neural ODEs: An Empirical Study". Experiments from the paper
  ☆13Apr 27, 2020Updated 5 years ago
• HrishikeshVish / GIOROM

  View on GitHub
  Main repo for GIOROM
  ☆18Sep 28, 2025Updated 4 months ago
• formll / dog

  View on GitHub
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆64Aug 23, 2023Updated 2 years ago
• zyushun / hessian-spectrum

  View on GitHub
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆63Mar 11, 2025Updated 11 months ago
• uuujf / SGDNoise

  View on GitHub
  [ICML 2019] The Anisotropic Noise in Stochastic Gradient Descent: Its Behavior of Escaping from Sharp Minima and Regularization Effects
  ☆15Apr 12, 2020Updated 5 years ago
• ForJadeForest / Lever-LM

  View on GitHub
  The Code for Lever LM: Configuring In-Context Sequence to Lever Large Vision Language Models
  ☆17Oct 4, 2024Updated last year
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning

  View on GitHub
  ☆14May 4, 2024Updated last year
• clear-nus / OCFGAN

  View on GitHub
  Pytorch implementation of OCFGAN-GP (CVPR 2020, Oral).
  ☆15Apr 3, 2020Updated 5 years ago
• namhoonlee / spp-public

  View on GitHub
  A Signal Propagation Perspective for Pruning Neural Networks at Initialization
  ☆14Jun 23, 2020Updated 5 years ago
• radarFudan / Curse-of-memory

  View on GitHub
  Curse-of-memory phenomenon of RNNs in sequence modelling
  ☆19May 8, 2025Updated 9 months ago
• hanshen95 / penalized-bilevel-gradient-descent

  View on GitHub
  An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.
  ☆19Feb 13, 2023Updated 3 years ago
• alxndrTL / losscape

  View on GitHub
  ☆20Jun 2, 2024Updated last year
• wjxts / RegularizedBN

  View on GitHub
  ☆21Dec 30, 2022Updated 3 years ago
• AngusDujw / FTD-distillation

  View on GitHub
  The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)
  ☆40Mar 25, 2023Updated 2 years ago
• amirgholami / PyHessian

  View on GitHub
  PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks
  ☆775Jul 10, 2025Updated 7 months ago
• fangyuan-ksgk / selective-attention-transformer

  View on GitHub
  Unofficial Implementation of Selective Attention Transformer
  ☆20Oct 31, 2024Updated last year
• outergroup / vexpr

  View on GitHub
  Write your code as tree-like expressions, then transform it
  ☆21Jan 9, 2024Updated 2 years ago
• delta-lab-ai / pde-controller

  View on GitHub
  ☆25Jun 12, 2025Updated 8 months ago
• kaistAI / factual-knowledge-acquisition

  View on GitHub
  ☆24Dec 12, 2025Updated 2 months ago
• MadryLab / journey-TRAK

  View on GitHub
  Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"
  ☆25Dec 12, 2023Updated 2 years ago
• noahgolmant / pytorch-hessian-eigenthings

  View on GitHub
  Efficient PyTorch Hessian eigendecomposition tools!
  ☆384Feb 29, 2024Updated last year
• mcbal / afem

  View on GitHub
  Implementation of approximate free-energy minimization in PyTorch
  ☆21Oct 16, 2021Updated 4 years ago
• chengxiang / LinearTransformer

  View on GitHub
  Pytorch code for experiments on Linear Transformers
  ☆24Jan 12, 2024Updated 2 years ago
• damek / gd-lean

  View on GitHub
  ☆31Feb 8, 2026Updated last week