thetechdude124 / Adam-Optimization-From-ScratchLinks
📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.
☆18Updated 2 years ago
Alternatives and similar repositories for Adam-Optimization-From-Scratch
Users that are interested in Adam-Optimization-From-Scratch are comparing it to the libraries listed below
Sorting:
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆45Updated last year
- Quantify geometric intelligence in natural and artificial brains.☆51Updated this week
- ☆18Updated last month
- Representation Learning on Topological Domains☆81Updated this week
- Collection of tests performed during the study of the new Kolmogorov-Arnold Neural Networks (KAN)☆39Updated 4 months ago
- A simple example of VAEs with KANs☆12Updated last year
- Official PyTorch and JAX Implementation of "Harmonics of Learning: Universal Fourier Features Emerge in Invariant Networks"☆38Updated last year
- ☆31Updated last year
- ☆10Updated 2 years ago
- Generate graph/data embeddings multiple ways☆54Updated this week
- The Zebrafish Activity Prediction Benchmark measures progress on the problem of predicting cellular-resolution neural activity throughout…☆41Updated 3 weeks ago
- Deep denoising pushes the limit of functional data acquisition by recovering high SNR calcium traces from low SNR videos acquired using l…☆14Updated this week
- Physics-inspired transformer modules based on mean-field dynamics of vector-spin models in JAX☆41Updated last year
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 5 months ago
- Automatic identification of regions in the latent space of a model that correspond to unique concepts, namely to concepts with a semantic…☆14Updated last year
- "Awesome DL-Based MRI Reconstruction" is a comprehensive, curated repository featuring resources, tools, and research papers focused on l…☆61Updated 2 weeks ago
- FastFeedForward Networks☆20Updated last year
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆50Updated 11 months ago
- Effort to open-source 10.5 trillion parameter Gemini model.☆17Updated last year
- ☆13Updated 8 months ago
- TopoBench is a Python library designed to standardize benchmarking and accelerate research in Topological Deep Learning☆127Updated this week
- Understanding how features learned by neural networks evolve throughout training☆36Updated 8 months ago
- ☆174Updated last year
- Train your PyTorch model without having to write the boring code☆16Updated 5 years ago
- Official repository for Cell Attention Networks☆14Updated last year
- TorchEsegeta: Interpretability and Explainability pipeline for PyTorch☆20Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 9 months ago
- alternative way to calculating self attention☆18Updated last year
- PAL: Predictive Analysis & Laws of Large Language Models☆36Updated 5 months ago
- Pokedex for LLMs☆13Updated 2 months ago