ivallesp / awesome-optimizers
Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)
☆47Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for awesome-optimizers
- ☆59Updated 2 months ago
- ☆16Updated 2 years ago
- Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.☆33Updated last year
- Stochastic Mirror Descent on CIFAR-10☆18Updated 5 years ago
- Repository containing article with examples of custom activation functions for Pytorch☆11Updated 4 years ago
- ☆48Updated last year
- ☆21Updated last year
- ☆28Updated 2 years ago
- Repo for the paper "Landscape Surrogate Learning Decision Losses for Mathematical Optimization Under Partial Information"☆36Updated last year
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆53Updated 2 years ago
- A pytorch implementation for the LSTM experiments in the paper: Why Gradient Clipping Accelerates Training: A Theoretical Justification f…☆44Updated 4 years ago
- [NeurIPS 2020] Coresets for Robust Training of Neural Networks against Noisy Labels☆33Updated 3 years ago
- ICLR 2021☆44Updated 3 years ago
- Code for "Robust Multi-Objective Bayesian Optimization Under Input Noise"☆51Updated 2 years ago
- Learning Dynamical Systems that Generalize Across Environments☆19Updated 2 years ago
- PyTorch reimplementation of the Smooth ReLU activation function proposed in the paper "Real World Large Scale Recommendation Systems Repr…☆21Updated 2 years ago
- A regularized self-labeling approach to improve the generalization and robustness of fine-tuned models☆27Updated 2 years ago
- ☆35Updated 2 years ago
- FlexiBO: Cost-Aware Multi-Objective Optimization of Deep Neural Networks☆13Updated last year
- Explores the ideas presented in Deep Ensembles: A Loss Landscape Perspective (https://arxiv.org/abs/1912.02757) by Stanislav Fort, Huiyi …☆62Updated 4 years ago
- Official Repo for "Efficient task-specific data valuation for nearest neighbor algorithms"☆26Updated 4 years ago
- PyTorch Implementation of the Multi-gate Mixture-of-Experts with Exclusivity (MMoEEx)☆30Updated 3 years ago
- Code for "Decision-Focused Learning without Differentiable Optimization: Learning Locally Optimized Decision Losses"☆23Updated 8 months ago
- Winning Solution of the NeurIPS 2020 Competition on Predicting Generalization in Deep Learning☆39Updated 3 years ago
- RecZilla: Metalearning for algorithm selection on Recommender Systems☆22Updated last year
- Benchmark time series data sets for PyTorch☆34Updated 9 months ago
- ☆42Updated 4 years ago
- ☆18Updated 4 years ago
- ☆13Updated 3 years ago
- Code for the ICML 2021 paper "Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation", Haoxi…☆67Updated 3 years ago