epfml / optML-pkuLinks
summer school materials
☆44Updated last year
Alternatives and similar repositories for optML-pku
Users that are interested in optML-pku are comparing it to the libraries listed below
Sorting:
- Neural Tangent Kernel Papers☆112Updated 4 months ago
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 6 months ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆181Updated 5 months ago
- ☆67Updated 6 months ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆48Updated 3 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆57Updated 7 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆59Updated 2 months ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆104Updated 11 months ago
- ☆32Updated last year
- Benchmark for bi-level optimization solvers☆46Updated 2 weeks ago
- ☆52Updated last year
- Bi-level Optimization for Advanced Deep Learning☆45Updated 3 years ago
- Collect optimizer related papers, data, repositories☆91Updated 6 months ago
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆13Updated 3 years ago
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated last month
- Deep Learning & Information Bottleneck☆60Updated last year
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆36Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆26Updated 11 months ago
- Sampling with gradient-based Markov Chain Monte Carlo approaches☆101Updated last year
- ☆16Updated 8 months ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆31Updated 7 months ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆108Updated 6 months ago
- [ICML 2021] This is the official github repo for training L_inf dist nets with high certified accuracy.☆42Updated 3 years ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated last year
- Visualization of mean field and neural tangent kernel regime☆20Updated 10 months ago
- ☆13Updated 2 years ago
- Pytorch code for experiments on Linear Transformers☆21Updated last year
- ☆30Updated last year
- ☆54Updated 6 months ago
- Distributed K-FAC preconditioner for PyTorch☆87Updated last week