thetechdude124 / Adam-Optimization-From-Scratch
📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.
☆14Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for Adam-Optimization-From-Scratch
- FastFeedForward Networks☆18Updated 11 months ago
- Software for matching event participants based on interest using language models☆58Updated 6 months ago
- ☆27Updated 4 months ago
- Foundational model for the Neurosity Crown☆49Updated 4 months ago
- A registry of tutorials, workshop material, videos and other educational resources to help you learn more about DataLad.☆14Updated last year
- LangChain + LiteLLM that works☆25Updated 3 weeks ago
- Stream of my favorite papers and links☆36Updated 2 months ago
- ☆25Updated 3 months ago
- Repository for the GSoC project 'Towards a Neural Extraction Framework'☆20Updated last month
- Energy Consumption-Aware Tabular Benchmark For Neural Architecture Search☆10Updated 10 months ago
- 🔮✍🏻 Automatically organize, analyze, and augment the quality of your obsidian.md notes with AI.☆12Updated 2 months ago
- Every way to change your mind☆37Updated last week
- Quantify geometric intelligence in natural and artificial brains.☆48Updated 2 months ago
- Benchmark structured generation libraries☆22Updated 3 weeks ago
- RAG on codebases using treesitter and LanceDB☆32Updated this week
- High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial…☆42Updated 4 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆23Updated last week
- ☆9Updated 3 months ago
- Forecasting high-impact research topics via machine learning on evolving knowledge graphs☆21Updated last month
- ☆48Updated last year
- ☆25Updated 7 months ago
- ☆20Updated 2 weeks ago
- Reverse engineering neural networks☆22Updated last year
- A package for defining deep learning models using categorical algebraic expressions.☆56Updated 3 months ago
- Understanding how features learned by neural networks evolve throughout training☆31Updated 3 weeks ago
- 🏥 Health monitor for a Petals swarm☆33Updated 3 months ago
- My solutions for Advanced Python Mastery (course by @dabeaz)☆12Updated 9 months ago
- alternative way to calculating self attention☆18Updated 5 months ago
- Synthetic data derived by templating, few shot prompting, transformations on public domain corpora, and monte carlo tree search.☆22Updated last month
- MindMapper is an innovative program that empowers intelligent agents to navigate complex thought landscapes and collaboratively map their…☆28Updated 6 months ago