thetechdude124 / Adam-Optimization-From-ScratchLinks
📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.
☆21Updated 3 years ago
Alternatives and similar repositories for Adam-Optimization-From-Scratch
Users that are interested in Adam-Optimization-From-Scratch are comparing it to the libraries listed below
Sorting:
- ☆28Updated last year
- Toy genetic algorithm in Pytorch☆52Updated 6 months ago
- Training hybrid models for dummies.☆28Updated last week
- ☆61Updated 4 months ago
- A simple example of VAEs with KANs☆11Updated last year
- The application is a end-user training and evaluation system for standard knowledge graph embedding models. It was developed to optimise …☆18Updated 5 months ago
- Simple repository for training small reasoning models☆44Updated 9 months ago
- KernelBench v2: Can LLMs Write GPU Kernels? - Benchmark with Torch -> Triton (and more!) problems☆21Updated 4 months ago
- alternative way to calculating self attention☆18Updated last year
- ☆16Updated last year
- A package for defining deep learning models using categorical algebraic expressions.☆61Updated last year
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆45Updated last year
- Code associated to papers on superposition (in ML interpretability)☆33Updated 3 years ago
- Tensor-Slayer : Manipulate weights and tensors of LLMs to achieve performance upgrades and introduce a novel inferenceless mechanistic in…☆25Updated 5 months ago
- Clean RL implementation using MLX☆33Updated last year
- Your favourite classical machine learning algos on the GPU/TPU☆20Updated 10 months ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆74Updated 4 months ago
- TensorFlow implementation of involution.☆13Updated 4 years ago
- High-performance tokenized language data-loader for Python C++ extension☆13Updated last year
- Interactive demos describing the main concepts behind GFlowNets☆11Updated 2 years ago
- open source alpha evolve☆66Updated 5 months ago
- Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.☆15Updated last year
- ☆62Updated 8 months ago
- Exploration using DSPy to optimize modules to maximize performance on the OpenToM dataset☆23Updated last year
- The official evaluation suite and dynamic data release for MixEval.☆11Updated last year
- Flexible, efficient, and context-aware generation from large unstructured knowledge sources.☆17Updated last year
- Simplified implementation of UMAP like dimensionality reduction algorithm☆53Updated 11 months ago
- ML/DL Math and Method notes☆64Updated last year
- Tutorial for Harvard Medical School ML from Scratch Series: Transformer from Scratch. Demo the usage of transformer in various domains: M…☆45Updated 2 years ago
- Code for minimum-entropy coupling.☆32Updated last year