epfml / optML-pku
summer school materials
☆45Updated last year
Related projects ⓘ
Alternatives and complementary repositories for optML-pku
- Neural Tangent Kernel Papers☆92Updated 8 months ago
- Welcome to the 'In Context Learning Theory' Reading Group☆22Updated this week
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆24Updated last week
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆43Updated 2 years ago
- ☆59Updated 3 years ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆143Updated 2 weeks ago
- Collect optimizer related papers, data, repositories☆80Updated 11 months ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆73Updated 4 months ago
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆14Updated 2 years ago
- Bi-level Optimization for Advanced Deep Learning☆39Updated 2 years ago
- Deep Learning & Information Bottleneck☆50Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆40Updated 6 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆18Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆40Updated last month
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆44Updated 5 months ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆14Updated this week
- Visualization of mean field and neural tangent kernel regime☆20Updated 3 months ago
- ☆26Updated last year
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆88Updated 6 months ago
- Code for visualizing the loss landscape of neural nets☆10Updated 4 years ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆16Updated last year
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆53Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆97Updated 4 years ago
- [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics☆18Updated last year
- ☆25Updated last year
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆10Updated last year
- [ICML 2021] This is the official github repo for training L_inf dist nets with high certified accuracy.☆41Updated 2 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆64Updated 4 years ago
- Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.☆11Updated 2 years ago
- Distributed K-FAC Preconditioner for PyTorch☆80Updated this week