epfml / optML-pku
summer school materials
☆44Updated last year
Alternatives and similar repositories for optML-pku:
Users that are interested in optML-pku are comparing it to the libraries listed below
- Welcome to the 'In Context Learning Theory' Reading Group☆28Updated 4 months ago
- Neural Tangent Kernel Papers☆108Updated 2 months ago
- ☆65Updated 3 months ago
- Collect optimizer related papers, data, repositories☆89Updated 4 months ago
- Python implementation of Scaling Neural Tangent Kernels via Sketching and Random Features☆13Updated 3 years ago
- Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…☆175Updated 3 months ago
- Example code for paper "Bilevel Optimization: Nonasymptotic Analysis and Faster Algorithms"☆47Updated 3 years ago
- Benchmark for bi-level optimization solvers☆44Updated 4 months ago
- ☆31Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆30Updated 5 months ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆52Updated 5 months ago
- Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.☆13Updated 2 years ago
- ☆49Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆24Updated 9 months ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 8 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆53Updated 3 weeks ago
- Deep Learning & Information Bottleneck☆58Updated last year
- LibMOON is a standard and flexible framework to study gradient-based multiobjective optimization.☆87Updated this week
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆32Updated 4 months ago
- A python package providing a benchmark with various specified distribution shift patterns.☆57Updated last year
- This is an official repository for "LAVA: Data Valuation without Pre-Specified Learning Algorithms" (ICLR2023).☆48Updated 9 months ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆103Updated 4 months ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆67Updated 4 years ago
- Code for "Federated Accelerated Stochastic Gradient Descent" (NeurIPS 2020)☆15Updated 3 years ago
- [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆95Updated 9 months ago
- An implementation of the penalty-based bilevel gradient descent (PBGD) algorithm and the iterative differentiation (ITD/RHG) methods.☆17Updated 2 years ago
- PyTorch implementation for our ICLR 2024 paper "Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory…☆24Updated last year
- An Elegant Library for Bayesian Deep Learning in PyTorch☆25Updated 2 years ago
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week