epfml / optML-pkuLinks
summer school materials
☆44Updated 2 years ago
Alternatives and similar repositories for optML-pku
Users that are interested in optML-pku are comparing it to the libraries listed below
Sorting:
- Neural Tangent Kernel Papers☆115Updated 7 months ago
- Welcome to the 'In Context Learning Theory' Reading Group☆30Updated 9 months ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆191Updated 8 months ago
- Collect optimizer related papers, data, repositories☆97Updated 9 months ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆66Updated 10 months ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆110Updated last month
- ☆70Updated 8 months ago
- This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success o…☆282Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆62Updated 5 months ago
- ☆52Updated last year
- A curated list of Model Merging methods.☆92Updated 11 months ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆358Updated last month
- Deep Learning & Information Bottleneck☆61Updated 2 years ago
- ☆31Updated 2 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆33Updated 9 months ago
- [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics☆20Updated 2 years ago
- ☆33Updated 2 years ago
- Distributed K-FAC preconditioner for PyTorch☆89Updated last week
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆51Updated last year
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆13Updated 3 years ago
- [ICML 2024] DPZero: Private Fine-Tuning of Language Models without Backpropagation☆13Updated 11 months ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆49Updated 3 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- A python package providing a benchmark with various specified distribution shift patterns.☆58Updated last year
- (NeurIPS 2024) QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation☆30Updated 9 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago
- [ICML 2021] This is the official github repo for training L_inf dist nets with high certified accuracy.☆42Updated 3 years ago
- 😎 A curated list of tensor decomposition resources for model compression.☆81Updated this week
- An Elegant Library for Bayesian Deep Learning in PyTorch☆26Updated 2 years ago
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆31Updated last year