Laz4rz / GPT-2
Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish
☆170Updated 7 months ago
Alternatives and similar repositories for GPT-2:
Users that are interested in GPT-2 are comparing it to the libraries listed below
- Simple Transformer in Jax☆136Updated 9 months ago
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆250Updated 4 months ago
- ☆84Updated last month
- This repo has all the basic things you'll need in-order to understand complete vision transformer architecture and its various implementa…☆212Updated 2 months ago
- High Quality Resources on GPU Programming/Architecture☆581Updated 7 months ago
- Learnings and programs related to CUDA☆328Updated last month
- A really tiny autograd engine☆90Updated 11 months ago
- Solve puzzles to improve your tinygrad skills!☆120Updated last week
- ☆95Updated 5 months ago
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆306Updated last week
- a tiny multidimensional array implementation in C similar to numpy, but only one file.☆224Updated 7 months ago
- UNet diffusion model in pure CUDA☆600Updated 8 months ago
- Let's make all Machine learning algorithms from scratch!☆14Updated 8 months ago
- a tiny vectorstore implementation built with numpy.☆60Updated 10 months ago
- ☆98Updated 11 months ago
- The Tensor (or Array)☆427Updated 7 months ago
- An introduction to LLM Sampling☆77Updated 3 months ago
- Gradient descent is cool and all, but what if we could delete it?☆103Updated 2 weeks ago
- Tutorials on tinygrad☆355Updated 3 weeks ago
- (WIP) A small but powerful, homemade PyTorch from scratch.☆535Updated last week
- MLX port for xjdr's entropix sampler (mimics jax implementation)☆63Updated 4 months ago
- Fast bare-bones BPE for modern tokenizer training☆149Updated 5 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆783Updated 2 weeks ago
- could we make an ml stack in 100,000 lines of code?☆30Updated 8 months ago
- Vector search over tweets from the tweet archive using OpenAI embeddings and LanceDB☆54Updated 11 months ago