epfml / optML-pku
summer school materials
☆44Updated last year
Alternatives and similar repositories for optML-pku:
Users that are interested in optML-pku are comparing it to the libraries listed below
- Welcome to the 'In Context Learning Theory' Reading Group☆27Updated 2 months ago
- Neural Tangent Kernel Papers☆103Updated 2 weeks ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆27Updated 2 months ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆83Updated 7 months ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆163Updated last month
- ☆48Updated last year
- ☆63Updated last month
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆47Updated 3 years ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆48Updated 9 months ago
- [NeurIPS 2021] code for "Taxonomizing local versus global structure in neural network loss landscapes" https://arxiv.org/abs/2107.11228☆19Updated 3 years ago
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆14Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆49Updated 3 months ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆66Updated 4 years ago
- Distributed K-FAC Preconditioner for PyTorch☆84Updated this week
- Visualization of mean field and neural tangent kernel regime☆21Updated 6 months ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆30Updated 2 months ago
- ☆27Updated last year
- [ICML 2021] This is the official github repo for training L_inf dist nets with high certified accuracy.☆41Updated 2 years ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆16Updated last year
- [ICML 2023] Decentralized SGD and Average-direction SAM are Asymptotically Equivalent☆17Updated last year
- Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.☆13Updated 2 years ago
- LibMOON is a standard and flexible framework to study gradient-based multiobjective optimization.☆73Updated 2 months ago
- Collect optimizer related papers, data, repositories☆85Updated 2 months ago
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆45Updated 7 months ago
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆21Updated 7 months ago
- Code for "Federated Accelerated Stochastic Gradient Descent" (NeurIPS 2020)☆15Updated 3 years ago
- Benchmark for bi-level optimization solvers☆39Updated 2 months ago
- Bi-level Optimization for Advanced Deep Learning☆42Updated 3 years ago
- Code repository is for "Federated Composite Optimization", to appear in ICML 2021☆12Updated 2 years ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆92Updated 2 months ago