eduardoleao052 / Autograd-from-scratch
Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
☆105Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for Autograd-from-scratch
- A deep learning framework created from scratch with Python and NumPy☆234Updated last year
- Highly commented implementations of Transformers in PyTorch☆129Updated last year
- A really tiny autograd engine☆87Updated 7 months ago
- ML/DL Math and Method notes☆57Updated 11 months ago
- A Jax-based library for designing and training transformer models from scratch.☆276Updated 2 months ago
- Recreating PyTorch from scratch (C/C++, CUDA, NCCL and Python, with multi-GPU support and automatic differentiation!)☆114Updated 5 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines☆195Updated 6 months ago
- A pure NumPy implementation of Mamba.☆216Updated 4 months ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊☆111Updated last week
- ☆113Updated 2 weeks ago
- Simplified implementation of UMAP like dimensionality reduction algorithm☆40Updated this week
- Complete implementation of Llama2 with/without KV cache & inference 🚀☆47Updated 6 months ago
- Andrej Kapathy's micrograd implemented in c☆29Updated 3 months ago
- A tool to analyze and debug neural networks in pytorch. Use a GUI to traverse the computation graph and view the data from many different…☆271Updated 3 weeks ago
- TensorHue is a Python library that allows you to visualize tensors right in your console, making understanding and debugging tensor conte…☆111Updated last month
- Autograd to GPT-2 completely from scratch☆107Updated 3 months ago
- ☆133Updated 9 months ago
- Functional local implementations of main model parallelism approaches☆95Updated last year
- Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead☆121Updated this week
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆57Updated 4 months ago
- ☆204Updated 4 months ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆86Updated last year
- I learn about and explain quantization☆25Updated 7 months ago
- Fast bare-bones BPE for modern tokenizer training☆142Updated last month
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆85Updated 2 months ago
- Notebooks for the "JAX in Action" book☆116Updated 5 months ago
- ☆197Updated 4 months ago
- code for training & evaluating Contextual Document Embedding models☆119Updated this week
- Solve puzzles to improve your tinygrad skills!☆87Updated 2 months ago
- A miniture AI training framework for PyTorch☆34Updated last year