apoorvnandan / lilgrad
pytorch from scratch in pure C/CUDA and python
☆40Updated 5 months ago
Alternatives and similar repositories for lilgrad:
Users that are interested in lilgrad are comparing it to the libraries listed below
- Learning about CUDA by writing PTX code.☆123Updated last year
- Andrej Kapathy's micrograd implemented in c☆28Updated 7 months ago
- Learnings and programs related to CUDA☆323Updated 3 weeks ago
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆251Updated 3 months ago
- ☆46Updated 7 months ago
- Multi-Threaded FP32 Matrix Multiplication on x86 CPUs☆340Updated 3 weeks ago
- could we make an ml stack in 100,000 lines of code?☆30Updated 7 months ago
- LLM training in simple, raw C/CUDA☆92Updated 10 months ago
- ☆72Updated this week
- my little linear algebra library☆47Updated 8 months ago
- High-Performance SGEMM on CUDA devices☆86Updated last month
- machine learning from absolute scratch in c. gradients, linear algebra ops & everything else without using any third party library!☆21Updated 7 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆31Updated this week
- A really tiny autograd engine☆90Updated 11 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆300Updated this week
- GPT-2 in C☆65Updated 2 months ago
- Notes on "Programming Massively Parallel Processors" by Hwu, Kirk, and Hajj (4th ed.)☆52Updated 7 months ago
- Solve puzzles to improve your tinygrad skills!☆118Updated this week
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆169Updated 7 months ago
- Tensor library with autograd using only Rust's standard library☆65Updated 8 months ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆128Updated 4 months ago
- a Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization in pure C.☆21Updated 8 months ago
- Visualization of cache-optimized matrix multiplication☆104Updated 5 years ago
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆125Updated last year
- This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…☆212Updated 2 months ago