epfml / optML-pku
summer school materials
☆45Updated last year
Related projects ⓘ
Alternatives and complementary repositories for optML-pku
- Neural Tangent Kernel Papers☆94Updated 8 months ago
- Welcome to the 'In Context Learning Theory' Reading Group☆22Updated last week
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆143Updated 3 weeks ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆73Updated 4 months ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆24Updated 2 weeks ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆43Updated last month
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆43Updated 2 years ago
- ☆59Updated 3 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆42Updated 6 months ago
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆14Updated 2 years ago
- ☆43Updated last year
- Collect optimizer related papers, data, repositories☆82Updated this week
- [ICML 2021] This is the official github repo for training L_inf dist nets with high certified accuracy.☆41Updated 2 years ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆18Updated last week
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆44Updated 5 months ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 3 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆18Updated 2 years ago
- Distributed K-FAC Preconditioner for PyTorch☆80Updated this week
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆10Updated last year
- [ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent☆16Updated 11 months ago
- Deep Learning & Information Bottleneck☆50Updated last year
- Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.☆11Updated 2 years ago
- This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success o…☆249Updated 7 months ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆16Updated last year
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆28Updated 11 months ago
- code to show F-Principle in the DNN training☆59Updated 2 years ago
- [ICLR 2022] Training L_inf-dist-net with faster acceleration and better training strategies☆22Updated 2 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆64Updated 4 years ago
- ☆13Updated last year
- Pytorch code for experiments on Linear Transformers☆13Updated 10 months ago