zeke-xie / deep-learning-dynamics-paper-list
This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆259Updated 9 months ago
Alternatives and similar repositories for deep-learning-dynamics-paper-list:
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆145Updated last year
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆163Updated last month
- Welcome to the 'In Context Learning Theory' Reading Group☆27Updated 2 months ago
- Neural Tangent Kernel Papers☆103Updated 2 weeks ago
- ☆216Updated 2 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆282Updated 3 weeks ago
- Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)☆283Updated last year
- Solution and Useful Links☆41Updated 2 years ago
- a collection of AWESOME things about Optimal Transport in Deep Learning☆229Updated 8 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆48Updated 9 months ago
- Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms☆270Updated last year
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆210Updated 3 months ago
- summer school materials☆44Updated last year
- This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.☆336Updated 8 months ago
- ☆43Updated 4 months ago
- A lecture note for understanding deep learning☆234Updated 2 weeks ago
- ☆63Updated last month
- Reading list for research topics in state-space models☆257Updated last week
- A curated list for awesome discrete diffusion models resources.☆209Updated last week
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆30Updated 2 months ago
- ☆48Updated last year
- Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch☆316Updated last year
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆561Updated 3 weeks ago
- A summary of related works about flow matching, stochastic interpolants☆376Updated 6 months ago
- Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)☆197Updated 2 years ago
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆172Updated 5 years ago
- Laplace approximations for Deep Learning.☆485Updated last month
- Code for reproducing results in the sliced score matching paper (UAI 2019)☆141Updated 5 years ago
- ☆186Updated last year