xie-lab-ml / deep-learning-dynamics-paper-listLinks
This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success of deep learning attributes to both network architecture and stochastic optimization. Thus, deep learning dynamics play an essentially important role in theoretical foundation of deep learning.
☆282Updated last year
Alternatives and similar repositories for deep-learning-dynamics-paper-list
Users that are interested in deep-learning-dynamics-paper-list are comparing it to the libraries listed below
Sorting:
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆191Updated 7 months ago
- [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…☆150Updated 2 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆345Updated last month
- Welcome to the 'In Context Learning Theory' Reading Group☆30Updated 9 months ago
- Neural Tangent Kernel Papers☆115Updated 7 months ago
- Collecting research materials on EBM/EBL (Energy Based Models, Energy Based Learning)☆331Updated last month
- ☆232Updated 2 years ago
- summer school materials☆44Updated 2 years ago
- Open-L2O: A Comprehensive and Reproducible Benchmark for Learning to Optimize Algorithms☆280Updated 2 years ago
- This is a curated list for Information Bottleneck Principle, in memory of Professor Naftali Tishby.☆367Updated last year
- ☆50Updated 10 months ago
- a collection of AWESOME things about Optimal Transport in Deep Learning☆295Updated last year
- Summer course on mathematical theory of deep learning☆53Updated 6 years ago
- ☆70Updated 8 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆61Updated 5 months ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆198Updated last year
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆37Updated 2 months ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆109Updated last month
- [ICLR 2025 Spotlight] Code release for "Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training"☆13Updated 6 months ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆49Updated 3 years ago
- Collection of papers on state-space models☆596Updated 3 months ago
- ReduNet☆540Updated 3 years ago
- ☆52Updated last year
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆750Updated last month
- Official Implementation of Learning Diverse and Discriminative Representations via the Principle of Maximal Coding Rate Reduction (2020)☆200Updated 2 years ago
- Awesome papers on weight-space learning☆30Updated 3 months ago
- Template and style files for ICLR☆226Updated 2 months ago
- [TPAMI 2023] Low Dimensional Landscape Hypothesis is True: DNNs can be Trained in Tiny Subspaces☆42Updated 3 years ago
- A list of awesome papers and cool resources on optimal transport and its applications in general! As you will notice, this list is curren…☆228Updated 4 years ago
- [NeurIPS 2022] A novel 1-Lipschitz network that can be efficiently trained to achieve certified L-infinity robustness for free!☆31Updated 2 years ago