joey00072 / Tinytorch
A really tiny autograd engine
☆92Updated last year
Alternatives and similar repositories for Tinytorch:
Users that are interested in Tinytorch are comparing it to the libraries listed below
- Simple Transformer in Jax☆136Updated 10 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆63Updated last week
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆65Updated last month
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆174Updated 9 months ago
- Collection of autoregressive model implementation☆85Updated last week
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Updated last year
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆180Updated last year
- Small scale distributed training of sequential deep learning models, built on Numpy and MPI.☆130Updated last year
- Solve puzzles. Learn CUDA.☆64Updated last year
- prime-rl is a codebase for decentralized RL training at scale☆85Updated this week
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆98Updated last month
- supporting pytorch FSDP for optimizers☆80Updated 4 months ago
- Learning about CUDA by writing PTX code.☆128Updated last year
- ☆78Updated 10 months ago
- could we make an ml stack in 100,000 lines of code?☆42Updated 9 months ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆129Updated 5 months ago
- ☆155Updated last year
- Andrej Kapathy's micrograd implemented in c☆28Updated 8 months ago
- ☆99Updated last year
- ☆27Updated 9 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 8 months ago
- ☆23Updated 9 months ago
- ☆61Updated last year
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.☆51Updated last year
- An introduction to LLM Sampling☆77Updated 4 months ago
- This repository contain the simple llama3 implementation in pure jax.☆63Updated 2 months ago
- A puzzle to learn about prompting☆127Updated last year
- ☆88Updated last year
- ☆45Updated last month
- Tensor library with autograd using only Rust's standard library☆67Updated 10 months ago