thetechdude124 / Adam-Optimization-From-ScratchLinks
📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.
☆22Updated 3 years ago
Alternatives and similar repositories for Adam-Optimization-From-Scratch
Users that are interested in Adam-Optimization-From-Scratch are comparing it to the libraries listed below
Sorting:
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆75Updated 7 months ago
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆44Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- Rust Implementation of micrograd☆53Updated last year
- ☆27Updated last year
- TensorFlow implementation of involution.☆13Updated 4 years ago
- ☆68Updated 7 months ago
- Toy genetic algorithm in Pytorch☆55Updated 9 months ago
- ☆30Updated last year
- A package for defining deep learning models using categorical algebraic expressions.☆61Updated last year
- Understanding how features learned by neural networks evolve throughout training☆41Updated last year
- Automatic identification of regions in the latent space of a model that correspond to unique concepts, namely to concepts with a semantic…☆14Updated 2 years ago
- gzip Predicts Data-dependent Scaling Laws☆34Updated last year
- Fine-grained, dynamic control of neural network topology in JAX.☆21Updated 2 years ago
- A simple example of VAEs with KANs☆11Updated last year
- aesthetic tensor visualiser☆28Updated 9 months ago
- Hub for researchers exploring VLMs and Multimodal Learning:)☆61Updated last week
- Tensor-Slayer : Manipulate weights and tensors of LLMs to achieve performance upgrades and introduce a novel inferenceless mechanistic in…☆27Updated 8 months ago
- ☆64Updated 11 months ago
- Code associated to papers on superposition (in ML interpretability)☆35Updated 3 years ago
- A Gentle Principled Introduction to Deep Reinforcement Learning☆19Updated 9 months ago
- ☆40Updated last year
- KernelBench v2: Can LLMs Write GPU Kernels? - Benchmark with Torch -> Triton (and more!) problems☆21Updated 6 months ago
- The application is a end-user training and evaluation system for standard knowledge graph embedding models. It was developed to optimise …☆18Updated 8 months ago
- Latent Large Language Models☆19Updated last year
- Because we don't want a jupyter notebook mess...☆61Updated 7 months ago
- Your favourite classical machine learning algos on the GPU/TPU☆21Updated last month
- Stream of my favorite papers and links☆44Updated 3 weeks ago
- ☆19Updated last week
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆26Updated last year