ivallesp / awesome-optimizersLinks
Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)
☆50Updated 5 years ago
Alternatives and similar repositories for awesome-optimizers
Users that are interested in awesome-optimizers are comparing it to the libraries listed below
Sorting:
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆37Updated 2 years ago
- [ICLR 2022] "Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How" by Yuning You, Yue Cao, Tianl…☆14Updated 3 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Updated 5 years ago
- Official implementation of Learning The Pareto Front With HyperNetworks [ICLR 2021]☆105Updated 3 years ago
- ☆29Updated 3 years ago
- Neural Architecture Search + Cascades | Best Paper @ GECCO 2022☆15Updated 2 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- ☆29Updated last year
- ☆13Updated 3 years ago
- Some improvements on Adam☆28Updated 5 years ago
- code for the ddp tutorial☆32Updated 3 years ago
- NOMU: Neural Optimization-based Model Uncertainty☆10Updated 2 years ago
- ☆23Updated 2 years ago
- ☆73Updated last year
- ☆67Updated 6 years ago
- Code for Accelerated Linearized Laplace Approximation for Bayesian Deep Learning (ELLA, NeurIPS 22')☆16Updated 3 years ago
- Code for experiments to learn uncertainty☆30Updated 2 years ago
- Code for ICML 2020 paper: Do RNN and LSTM have Long Memory?☆17Updated 4 years ago
- A study on the following problems: what the memorization problem is in meta-learning; why memorization problem happens; and how we can pr…☆21Updated 2 years ago
- Official PyTorch implementation of "Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics" (https://openreview.net/forum…☆52Updated 5 years ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆22Updated 3 years ago
- Spatial Mixture-of-Experts☆21Updated 2 years ago
- PyTorch Implementation of Reptile☆21Updated 4 years ago
- Code for "Robust Multi-Objective Bayesian Optimization Under Input Noise"☆56Updated 3 years ago
- https://cs330.stanford.edu/☆62Updated 2 years ago
- Awesome list for Neural Network Optimization methods.☆82Updated 9 months ago
- Official implementation of Transformer Neural Processes☆78Updated 3 years ago
- Bayesian Optimization Hyperband Hyperparameter Optimization☆40Updated 4 years ago
- RecZilla: Metalearning for algorithm selection on Recommender Systems☆24Updated 2 years ago
- Implementation of SVRG and SAGA optimization algorithms for deep learning topics.☆74Updated 4 years ago