This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆304Apr 10, 2024Updated 2 years ago
Alternatives and similar repositories for deep-learning-dynamics-paper-list
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆150Feb 17, 2023Updated 3 years ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆211Apr 13, 2026Updated 3 months ago
- [KDD 2023] code for "Test accuracy vs. generalization gap: model selection in NLP without accessing training or testing data" https://arx…☆12Oct 17, 2022Updated 3 years ago
- Neural Tangent Kernel Papers☆123Jan 12, 2025Updated last year
- This framework implements key experiments on the sparse double descent phenomenon (ICML 2022).☆15Dec 13, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆790Jul 10, 2025Updated last year
- Codebase for the paper "A Gradient Flow Framework for Analyzing Network Pruning"☆20Jan 31, 2021Updated 5 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆65Mar 11, 2025Updated last year
- ☆10Dec 17, 2019Updated 6 years ago
- ☆14Oct 18, 2021Updated 4 years ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆19Feb 13, 2023Updated 3 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆404Jul 21, 2026Updated last week
- ☆29Jun 12, 2025Updated last year
- ☆13Jul 2, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Visualization of mean field and neural tangent kernel regime☆23Jul 25, 2024Updated 2 years ago
- ScalingOpt - Optimization Community☆104Jun 1, 2026Updated last month
- Efficient empirical NTKs in PyTorch☆22Jun 13, 2022Updated 4 years ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆37Apr 7, 2025Updated last year
- ☆35Dec 5, 2022Updated 3 years ago
- Quantification of Uncertainties in Neural Networks☆11Feb 25, 2026Updated 5 months ago
- Awesome papers in machine learning theory☆10Feb 12, 2022Updated 4 years ago
- ☆18Jan 17, 2024Updated 2 years ago
- Repository for the paper "Interpreting Temporal Graph Neural Networks with Koopman Theory"☆12Apr 7, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Experiments on trade-off among optimization, generalization and conflict aversion in multi-objective learning (MOL), and introducing MoDo…☆15Oct 21, 2023Updated 2 years ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆20Jan 7, 2022Updated 4 years ago
- Implementation of Beyond Neural Scaling beating power laws for deep models and prototype-based models☆35Oct 30, 2025Updated 8 months ago
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆173Nov 10, 2019Updated 6 years ago
- ☆27Feb 2, 2023Updated 3 years ago
- ☆23Nov 1, 2022Updated 3 years ago
- Piecewise Sparse Attention Is Wiser for Efficient Diffusion Transformers☆37Jul 1, 2026Updated 3 weeks ago
- Official implementation of the paper "Neural Hamilton: Can A.I. Understand Hamiltonian Mechanics?"☆14Jun 12, 2026Updated last month
- SE-PINN: Solving the Schrödinger Equation via Physics-Informed Machine Learning☆11Dec 17, 2025Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Finetune Google's pre-trained ViT models from HuggingFace's model hub.☆19Apr 4, 2021Updated 5 years ago
- Library for computing the Finite-time Lyapunov Exponents of 2D flows using xarray☆10Apr 25, 2022Updated 4 years ago
- This repository provides an improved LLamaGen Model, fine-tuned on 500,000 high-quality images, each accompanied by over 300 token prompt…☆30Oct 21, 2024Updated last year
- Sort out the researchers in the field of AI for Science☆20Apr 5, 2023Updated 3 years ago
- ☆15Mar 4, 2022Updated 4 years ago
- Awesome Lists for Tenure-Track Assistant Professors and PhD students. (助理教授/博士生生存指南)☆1,635Feb 1, 2024Updated 2 years ago
- The source code the for the ICLR'24 paper "Stabilizing Backpropagation Through Time to Learn Complex Physics"☆11May 17, 2024Updated 2 years ago