epfml / optML-pkuLinks
summer school materials
☆46Updated 2 years ago
Alternatives and similar repositories for optML-pku
Users that are interested in optML-pku are comparing it to the libraries listed below
Sorting:
- Neural Tangent Kernel Papers☆120Updated 10 months ago
- Welcome to the 'In Context Learning Theory' Reading Group☆30Updated last year
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆201Updated 11 months ago
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆117Updated 4 months ago
- ☆72Updated 11 months ago
- This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success o…☆288Updated last year
- Collect optimizer related papers, data, repositories☆98Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆33Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆63Updated 8 months ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆65Updated last year
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆378Updated 2 weeks ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated 7 months ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆51Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆36Updated last year
- Easily download anonymous Github repositories from https://anonymous.4open.science/ with a GUI interface☆97Updated last year
- ☆51Updated 2 years ago
- A python package providing a benchmark with various specified distribution shift patterns.☆58Updated 2 years ago
- ☆34Updated 2 years ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆50Updated 3 years ago
- [ICLR 2025 Spotlight] Code release for "Sharpness-Aware Minimization Efficiently Selects Flatter Minima Late In Training"☆16Updated 9 months ago
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆13Updated 3 years ago
- Deep Learning & Information Bottleneck☆62Updated 2 years ago
- OpenDataVal: a Unified Benchmark for Data Valuation in Python (NeurIPS 2023)☆99Updated 9 months ago
- [ICML 2024] DPZero: Private Fine-Tuning of Language Models without Backpropagation☆16Updated last year
- ☆11Updated 3 months ago
- ☆240Updated 2 years ago
- (NeurIPS 2024) QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation☆32Updated last week
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆124Updated last year
- A curated list of Model Merging methods.☆92Updated last year
- Bi-level Optimization for Advanced Deep Learning☆47Updated 3 years ago