xie-lab-ml / deep-learning-dynamics-paper-list
This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆272Updated last year
Alternatives and similar repositories for deep-learning-dynamics-paper-list:
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆177Updated 3 months ago
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆149Updated 2 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆321Updated this week
- Welcome to the 'In Context Learning Theory' Reading Group☆26Updated 5 months ago
- Neural Tangent Kernel Papers☆107Updated 3 months ago
- ☆222Updated 2 years ago
- Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)☆291Updated last year
- summer school materials☆44Updated last year
- ☆46Updated 6 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆56Updated last month
- This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.☆353Updated 11 months ago
- ☆67Updated 4 months ago
- ☆256Updated last month
- A Telegram bot to recommend arXiv papers☆266Updated this week
- Code for reproducing results in the sliced score matching paper (UAI 2019)☆145Updated 5 years ago
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆47Updated 3 years ago
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆579Updated last week
- A summary of related works about flow matching, stochastic interpolants☆429Updated 3 weeks ago
- Solution and Useful Links☆52Updated 2 years ago
- A curated list for awesome discrete diffusion models resources.☆296Updated 2 months ago
- Create animations for the optimization trajectory of neural nets☆152Updated last year
- ☆51Updated last year
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆97Updated 9 months ago
- Benchmark for bi-level optimization solvers☆44Updated 4 months ago
- ☆69Updated 7 months ago
- [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neur…☆33Updated 3 years ago
- A lecture note for understanding deep learning☆310Updated last week
- a collection of AWESOME things about Optimal Transport in Deep Learning☆253Updated 11 months ago
- Processed / Cleaned Data for Paper Copilot☆400Updated last week