epfml / optML-pkuLinks
summer school materials
☆44Updated last year
Alternatives and similar repositories for optML-pku
Users that are interested in optML-pku are comparing it to the libraries listed below
Sorting:
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 7 months ago
- ☆68Updated 6 months ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆49Updated 3 years ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆105Updated last year
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆60Updated 8 months ago
- Deep Learning & Information Bottleneck☆60Updated last year
- Neural Tangent Kernel Papers☆114Updated 5 months ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆184Updated 6 months ago
- Benchmark for bi-level optimization solvers☆46Updated last month
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆26Updated last year
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆59Updated 3 months ago
- ☆32Updated last year
- ☆52Updated last year
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆35Updated 2 months ago
- Bi-level Optimization for Advanced Deep Learning☆46Updated 3 years ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated last year
- Collect optimizer related papers, data, repositories☆91Updated 7 months ago
- [ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent☆19Updated last year
- [ICML 2021] This is the official github repo for training L_inf dist nets with high certified accuracy.☆42Updated 3 years ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 11 months ago
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆57Updated 2 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆31Updated 7 months ago
- Code for "Federated Accelerated Stochastic Gradient Descent" (NeurIPS 2020)☆15Updated 4 years ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆35Updated last year
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆41Updated 6 years ago
- [ICLR2023] NTK-SAP: Improving neural network pruning by aligning training dynamics☆18Updated 2 years ago
- Code for visualizing the loss landscape of neural nets☆10Updated 4 years ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆37Updated last month
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆13Updated 3 years ago