thetechdude124 / Adam-Optimization-From-ScratchLinks
📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.
☆22Updated 3 years ago
Alternatives and similar repositories for Adam-Optimization-From-Scratch
Users that are interested in Adam-Optimization-From-Scratch are comparing it to the libraries listed below
Sorting:
- Automatic identification of regions in the latent space of a model that correspond to unique concepts, namely to concepts with a semantic…☆14Updated last year
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆71Updated 2 months ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆45Updated last year
- ☆27Updated last year
- A package for defining deep learning models using categorical algebraic expressions.☆61Updated last year
- Tutorial for Harvard Medical School ML from Scratch Series: Transformer from Scratch. Demo the usage of transformer in various domains: M…☆45Updated 2 years ago
- Official PyTorch and JAX Implementation of "Harmonics of Learning: Universal Fourier Features Emerge in Invariant Networks"☆38Updated last year
- Understanding how features learned by neural networks evolve throughout training☆37Updated 10 months ago
- We integrate discrete diffusion models with neurosymbolic predictors for scalable and calibrated learning and reasoning☆40Updated 3 months ago
- 📰 Computing the information content of trained neural networks☆21Updated 3 years ago
- A simple example of VAEs with KANs☆12Updated last year
- open source alpha evolve☆67Updated 3 months ago
- Fine-grained, dynamic control of neural network topology in JAX.☆21Updated 2 years ago
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 8 months ago
- ☆56Updated 2 months ago
- Interactive demos describing the main concepts behind GFlowNets☆10Updated last year
- ☆39Updated last year
- How to use the Flax Linen API to build a convolutional neural network model and train it for image classification (using TensorFlow Datas…☆24Updated 2 years ago
- Simple repository for training small reasoning models☆38Updated 7 months ago
- About A collection of AWESOME things about information geometry Topics☆165Updated last year
- Rust Implementation of micrograd☆52Updated last year
- ☆57Updated 6 months ago
- Toy genetic algorithm in Pytorch☆53Updated 4 months ago
- A Python Library for Learning Non-Euclidean Representations☆62Updated last month
- Notebooks for the "Deep Learning with JAX" book☆154Updated 2 months ago
- Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.☆120Updated last year
- TensorFlow implementation of involution.☆13Updated 4 years ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆88Updated last year
- Jax like function transformation engine but micro, microjax☆33Updated 10 months ago
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 11 months ago