ivallesp / awesome-optimizersLinks
Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)
☆50Updated 5 years ago
Alternatives and similar repositories for awesome-optimizers
Users that are interested in awesome-optimizers are comparing it to the libraries listed below
Sorting:
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆65Updated 5 years ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆36Updated 2 years ago
- ☆29Updated 2 years ago
- a curated list of bayesian optimization tutorials, papers, softwares☆31Updated 4 years ago
- Official implementation of Learning The Pareto Front With HyperNetworks [ICLR 2021]☆104Updated 3 years ago
- Awesome list for Neural Network Optimization methods.☆80Updated 6 months ago
- ☆29Updated last year
- Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.☆33Updated last year
- code for the ddp tutorial☆32Updated 3 years ago
- ☆74Updated last year
- Calibration of Convolutional Neural Networks☆170Updated 2 years ago
- Neural Architecture Search + Cascades | Best Paper @ GECCO 2022☆15Updated 2 years ago
- Code for "Robust Multi-Objective Bayesian Optimization Under Input Noise"☆55Updated 3 years ago
- Some improvements on Adam☆28Updated 4 years ago
- ☆23Updated last year
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆46Updated 5 years ago
- Official PyTorch implementation of "Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error"☆36Updated 2 years ago
- [ICLR 2022] "Bayesian Modeling and Uncertainty Quantification for Learning to Optimize: What, Why, and How" by Yuning You, Yue Cao, Tianl…☆14Updated 3 years ago
- Introduction, selected papers and possible corresponding codes in our review paper "A Survey of Neural Trees"☆83Updated 2 years ago
- ☆88Updated 4 months ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆22Updated 3 years ago
- PyTorch Implementation of "Distilling a Neural Network Into a Soft Decision Tree." Nicholas Frosst, Geoffrey Hinton., 2017.☆103Updated last year
- ☆35Updated 3 years ago
- Introducing diverse tasks for NAS☆50Updated 2 years ago
- Last-layer Laplace approximation code examples☆83Updated 3 years ago
- This is the official implementation for COSMOS: a method to learn Pareto fronts that scales to large datasets and deep models.☆38Updated 4 years ago
- [ICLR '21] Interpretable Neural Architecture Search using Bayesian Optimisation with Weisfiler-Lehman Kernel (NAS-BOWL)☆24Updated 3 years ago
- Bayesianize: A Bayesian neural network wrapper in pytorch☆89Updated last year
- An implementation of the state-of-the-art Deep Active Learning algorithms☆104Updated last year
- Create animations for the optimization trajectory of neural nets☆158Updated last year