Neural Network optimizers implemented from scratch in numpy (Adam, Adadelta, RMSProp, SGD, etc.)
☆51Mar 21, 2020Updated 6 years ago
Alternatives and similar repositories for awesome-optimizers
Users that are interested in awesome-optimizers are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Oct 15, 2022Updated 3 years ago
- Learning Dynamical Systems that Generalize Across Environments☆20Feb 10, 2022Updated 4 years ago
- A Julia package for Differential Evolution MCMC☆14Mar 5, 2026Updated 3 weeks ago
- Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep …☆39Apr 13, 2023Updated 2 years ago
- ☆17May 1, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- KAIST Thesis Template☆16Jan 28, 2021Updated 5 years ago
- A collection of various gradient descent algorithms implemented in Python from scratch☆41Feb 28, 2023Updated 3 years ago
- This repository contains the official implementation of the paper "Reliable Graph Neural Networks via Robust Aggregation" (NeurIPS, 2020)…☆17Mar 16, 2022Updated 4 years ago
- The collection of my research papers' illustrations.☆20Oct 15, 2023Updated 2 years ago
- ☆24Dec 11, 2022Updated 3 years ago
- ☆18May 27, 2025Updated 10 months ago
- Generalizing to New Physical Systems via Context-Informed Dynamics Model☆27May 6, 2024Updated last year
- Visualization of various deep learning optimization algorithms using PyTorch automatic differentiation and optimizers.☆61Jun 21, 2018Updated 7 years ago
- Code for paper "Byzantine-Resilient Distributed Finite-Sum Optimization over Networks"☆18Nov 5, 2020Updated 5 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- AdaShift optimizer implementation in PyTorch☆18Jan 13, 2019Updated 7 years ago
- A collection of Matplotlib plot templates.☆25Oct 15, 2023Updated 2 years ago
- OCNG/ATMO 677 Geophysical Data Assimilation☆13Sep 7, 2016Updated 9 years ago
- FengQing is a data-driven model for medium-range weather forecasting jointly developed by the China Meteorological Administration and Sch…☆17Feb 24, 2025Updated last year
- [ICDM 2023] Momentum is All You Need for Data-Driven Adaptive Optimization☆26Mar 30, 2024Updated last year
- PyTorch implementation of AdaGraph: Unifying Predictive and Continuous Domain Adaptation through Graphs☆23Feb 6, 2023Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆218Apr 4, 2021Updated 4 years ago
- [ICLR 2020] Haotao Wang, Tianlong Chen, Zhangyang Wang, Kede Ma, "I Am Going MAD: Maximum Discrepancy Competition for Comparing Classifie…☆20Dec 30, 2021Updated 4 years ago
- ☆16Jan 2, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Evaluation Pipeline for medical tasks.☆12Feb 13, 2026Updated last month
- Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?☆18Jun 3, 2025Updated 9 months ago
- Deep Learning Library for R☆12May 6, 2018Updated 7 years ago
- ☆18Mar 17, 2023Updated 3 years ago
- Collection of notebooks exploring conv nets in detail.☆10Sep 14, 2017Updated 8 years ago
- ☆31Aug 16, 2021Updated 4 years ago
- The official code of TACL 2022, "Break, Perturb, Build: Automatic Perturbation of Reasoning Paths Through Question Decomposition".☆12Oct 18, 2021Updated 4 years ago
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆25Nov 26, 2019Updated 6 years ago
- ☆34Feb 20, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ICML 2020, Estimating Generalization under Distribution Shifts via Domain-Invariant Representations☆23Jun 30, 2020Updated 5 years ago
- DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization☆12Jun 15, 2022Updated 3 years ago
- Code for "Demonstration-free Autonomous Reinforcement Learning via Implicit and Bidirectional Curriculum" (ICML 2023)☆10Jul 6, 2023Updated 2 years ago
- Github repo for Peifeng's internship project☆13Nov 7, 2023Updated 2 years ago
- ☆10Nov 16, 2023Updated 2 years ago
- ☆10Nov 29, 2024Updated last year
- ProxyExplainer for Graph Neural Networks☆15Oct 24, 2024Updated last year