xie-lab-ml / deep-learning-dynamics-paper-list
This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆268Updated 11 months ago
Alternatives and similar repositories for deep-learning-dynamics-paper-list:
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆171Updated 2 months ago
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆148Updated 2 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆303Updated this week
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 4 months ago
- Neural Tangent Kernel Papers☆106Updated 2 months ago
- Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)☆289Updated last year
- ☆222Updated 2 years ago
- ☆254Updated last week
- Solution and Useful Links☆48Updated 2 years ago
- This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.☆345Updated 10 months ago
- summer school materials☆44Updated last year
- A lecture note for understanding deep learning☆296Updated 2 months ago
- ☆49Updated last year
- Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms☆275Updated last year
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆574Updated 2 weeks ago
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- Summer course on mathematical theory of deep learning☆52Updated 5 years ago
- a collection of AWESOME things about Optimal Transport in Deep Learning☆247Updated 10 months ago
- Paper List For Linking ODE and Deep Learning☆245Updated 5 years ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆102Updated 3 months ago
- ☆43Updated 5 months ago
- [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.☆59Updated last year
- Code for reproducing results in the sliced score matching paper (UAI 2019)☆144Updated 5 years ago
- PyTorch implementation of normalizing flow models☆805Updated 6 months ago
- ☆65Updated 3 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆53Updated last week
- A Telegram bot to recommend arXiv papers☆255Updated last month
- Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)☆198Updated 2 years ago
- Collection of papers on state-space models☆583Updated 2 weeks ago
- A summary of related works about flow matching, stochastic interpolants☆407Updated 7 months ago