This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆304Apr 10, 2024Updated 2 years ago
Alternatives and similar repositories for deep-learning-dynamics-paper-list
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neur…☆33Aug 3, 2021Updated 5 years ago
- [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.☆61Feb 3, 2024Updated 2 years ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆211Apr 13, 2026Updated 6 months ago
- The official code of "Mano: Restriking Manifold Optimization for LLM Training".☆26Jun 1, 2026Updated 5 months ago
- Neural Tangent Kernel Papers☆121Jan 12, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [KDD 2023] code for "Test accuracy vs. generalization gap: model selection in NLP without accessing training or testing data" https://arx…☆12Oct 17, 2022Updated 4 years ago
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- Welcome to the 'In Context Learning Theory' Reading Group☆31Nov 8, 2024Updated 2 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆66Mar 11, 2025Updated last year
- This framework implements key experiments on the sparse double descent phenomenon (ICML 2022).☆15Dec 13, 2022Updated 3 years ago
- ☆79Dec 7, 2024Updated last year
- ☆21Jan 4, 2023Updated 3 years ago
- Codebase for the paper "A Gradient Flow Framework for Analyzing Network Pruning"☆20Jan 31, 2021Updated 5 years ago
- ScalingOpt - Optimization Community☆109Sep 19, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [ICLR2025] IV-Mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesis☆39Feb 17, 2025Updated last year
- ☆14Oct 18, 2021Updated 5 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆412Oct 30, 2026Updated last week
- Code for reproducing figures and results in the paper ``Early stopping in deep networks: Double descent and how to eliminate it''☆15Jun 27, 2022Updated 4 years ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆20Feb 13, 2023Updated 3 years ago
- ☆29Jun 12, 2025Updated last year
- ☆20Dec 7, 2025Updated 11 months ago
- ☆13Jul 2, 2025Updated last year
- Code for paper: Regression as Classification: Influence of Task Formulation on Neural Network Features☆10Jul 31, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- [ICML 2023] Code for "A Three-regime Model of Network Pruning"☆11Oct 20, 2023Updated 3 years ago
- finding new ramsey bounds through scaling autoresearch☆50May 13, 2026Updated 5 months ago
- Official implementation for the paper "Controlled Sparsity via Constrained Optimization"☆12Aug 10, 2022Updated 4 years ago
- Offical Implementation of "PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing"☆12Sep 23, 2026Updated last month
- A curated list of awesome papers on dataset reduction, including dataset distillation (dataset condensation) and dataset pruning (coreset…☆62Jan 14, 2025Updated last year
- Code for ICML 24 paper "Implicit Representations via Operator Learning"☆13Jul 30, 2024Updated 2 years ago
- Repository for the paper "Interpreting Temporal Graph Neural Networks with Koopman Theory"☆12Apr 7, 2026Updated 7 months ago
- Awesome papers in machine learning theory☆10Feb 12, 2022Updated 4 years ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆38Apr 7, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Code for Paper (Policy Optimization in RLHF: The Impact of Out-of-preference Data)☆29Dec 19, 2023Updated 2 years ago
- Implementation of Beyond Neural Scaling beating power laws for deep models and prototype-based models☆35Oct 30, 2025Updated last year
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆174Nov 10, 2019Updated 6 years ago
- Experiments on trade-off among optimization, generalization and conflict aversion in multi-objective learning (MOL), and introducing MoDo…☆15Oct 21, 2023Updated 3 years ago
- ☆12Jan 16, 2025Updated last year
- Official Implementation of SWAD (NeurIPS 2021)☆174Dec 10, 2022Updated 3 years ago
- Library for computing the Finite-time Lyapunov Exponents of 2D flows using xarray☆10Apr 25, 2022Updated 4 years ago