zeke-xie / deep-learning-dynamics-paper-list
This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆249Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for deep-learning-dynamics-paper-list
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆141Updated last year
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆144Updated 3 weeks ago
- Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)☆279Updated 11 months ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆271Updated 2 weeks ago
- Welcome to the 'In Context Learning Theory' Reading Group☆22Updated 2 weeks ago
- Neural Tangent Kernel Papers☆94Updated 8 months ago
- This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.☆324Updated 6 months ago
- summer school materials☆45Updated last year
- ☆210Updated last year
- a collection of AWESOME things about Optimal Transport in Deep Learning☆198Updated 6 months ago
- Modern Fixed Point Systems using Pytorch☆82Updated last year
- ☆39Updated last month
- Code for reproducing results in the sliced score matching paper (UAI 2019)☆140Updated 4 years ago
- Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms☆264Updated last year
- Collection of papers on state-space models☆556Updated 2 weeks ago
- ☆244Updated 6 months ago
- Official implementation for Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models (ICML 2022), and a re…☆103Updated 2 years ago
- [Neural Computation, MIT Press] The PyTorch Implementation of Variable Optimizers/ Neural Variable Risk Minimization proposed in our Neur…☆33Updated 3 years ago
- A summary of related works about flow matching, stochastic interpolants☆337Updated 3 months ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆170Updated 9 months ago
- ☆181Updated 11 months ago
- A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application☆221Updated 7 months ago
- Reading list for research topics in state-space models☆242Updated 3 weeks ago
- A list of awesome papers and cool resources on optimal transport and its applications in general! As you will notice, this list is curren…☆206Updated 3 years ago
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆27Updated 2 years ago
- ☆299Updated 2 years ago
- Pytorch code for experiments on Linear Transformers☆13Updated 10 months ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆90Updated 7 months ago
- Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)☆193Updated last year
- Summer course on mathematical theory of deep learning☆52Updated 5 years ago