xie-lab-ml / deep-learning-dynamics-paper-listLinks
This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆276Updated last year
Alternatives and similar repositories for deep-learning-dynamics-paper-list
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below
Sorting:
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆150Updated 2 years ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆181Updated 5 months ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆326Updated this week
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 6 months ago
- Neural Tangent Kernel Papers☆112Updated 4 months ago
- Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)☆297Updated last year
- This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.☆361Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆59Updated 2 months ago
- ☆49Updated 8 months ago
- ☆227Updated 2 years ago
- summer school materials☆44Updated last year
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆740Updated last year
- Official implementation for Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models (ICML 2022), and a re…☆109Updated 2 years ago
- Code for reproducing results in the sliced score matching paper (UAI 2019)☆147Updated 5 years ago
- Summer course on mathematical theory of deep learning☆52Updated 5 years ago
- ☆67Updated 5 months ago
- Code for experiments in my blog post on the Neural Tangent Kernel: https://eigentales.com/NTK☆173Updated 5 years ago
- ☆52Updated last year
- A curated list for awesome discrete diffusion models resources.☆349Updated this week
- [ICML 2021] The official PyTorch Implementations of Positive-Negative Momentum Optimizers.☆28Updated 2 years ago
- Modern Fixed Point Systems using Pytorch☆93Updated last year
- Code for the paper Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Models (ICLR 2022 Outsta…☆172Updated 3 years ago
- ☆315Updated 2 years ago
- ☆84Updated 4 years ago
- Create animations for the optimization trajectory of neural nets☆155Updated last year
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆214Updated this week
- ☆67Updated 6 years ago
- ☆191Updated last year
- TorchOpt is an efficient library for differentiable optimization built upon PyTorch.☆593Updated 3 weeks ago
- Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms☆278Updated last year