ivallesp / awesome-optimizersLinks
Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)
☆50Updated 5 years ago
Alternatives and similar repositories for awesome-optimizers
Users that are interested in awesome-optimizers are comparing it to the libraries listed below
Sorting:
- Official implementation of Learning The Pareto Front With HyperNetworks [ICLR 2021]☆105Updated 3 years ago
- ☆30Updated 3 years ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆22Updated 3 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆47Updated 6 years ago
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆66Updated 5 years ago
- This is the official implementation for COSMOS: a method to learn Pareto fronts that scales to large datasets and deep models.☆39Updated 4 years ago
- RecZilla: Metalearning for algorithm selection on Recommender Systems☆25Updated 2 years ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆38Updated 2 years ago
- [ICLR 2022] "Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How" by Yuning You, Yue Cao, Tianl…☆14Updated 3 years ago
- Code for "Robust Multi-Objective Bayesian Optimization Under Input Noise"☆57Updated 3 years ago
- Neural Architecture Search + Cascades | Best Paper @ GECCO 2022☆15Updated 2 years ago
- ☆13Updated 3 years ago
- Official implementation of NeurIPS'21: Implicit SVD for Graph Representation Learning☆21Updated 4 years ago
- Official PyTorch implementation of "Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error"☆37Updated 2 years ago
- Code for the ICML 2021 paper "Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation", Haoxi…☆68Updated 4 years ago
- Spatial Mixture-of-Experts☆21Updated 3 years ago
- ☆23Updated 2 years ago
- Some improvements on Adam☆28Updated 5 years ago
- ☆18Updated 6 years ago
- ☆29Updated last year
- Bayesian Optimization Hyperband Hyperparameter Optimization☆41Updated 5 years ago
- Awesome list for Neural Network Optimization methods.☆81Updated 11 months ago
- Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.☆33Updated 2 years ago
- Code for ICML 2020 paper: Do RNN and LSTM have Long Memory?☆17Updated 5 years ago
- ☆72Updated last year
- NeurIPS 2022: Tree Mover’s Distance: Bridging Graph Metrics and Stability of Graph Neural Networks☆37Updated 2 years ago
- Official PyTorch implementation of "Physics-aware Difference Graph Networks for Sparsely-Observed Dynamics" (https://openreview.net/forum…☆52Updated 5 years ago
- ☆23Updated 3 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31Updated 4 years ago
- Welcome to Uncertainty Metrics! The goal of this library is to provide an easy-to-use interface for both measuring uncertainty across Goo…☆24Updated 5 years ago