karpathy / micrograd
A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API
☆11,820Updated 9 months ago
Alternatives and similar repositories for micrograd
Users that are interested in micrograd are comparing it to the libraries listed below
Sorting:
- An autoregressive character-level language model for making more things☆3,050Updated 11 months ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆21,866Updated 8 months ago
- You like pytorch? You like micrograd? You love tinygrad! ❤️☆28,778Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆41,189Updated 5 months ago
- Neural Networks: Zero to Hero☆13,712Updated 8 months ago
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆9,626Updated 10 months ago
- ☆3,950Updated last year
- Inference Llama 2 in one file of pure C☆18,371Updated 9 months ago
- Train transformer language models with reinforcement learning.☆13,624Updated this week
- Video+code lecture on building nanoGPT from scratch☆4,089Updated 9 months ago
- LLM training in simple, raw C/CUDA☆26,563Updated this week
- Pure Python from-scratch zero-dependency implementation of Bitcoin for educational purposes☆1,726Updated 3 years ago
- This repository contains demos I made with the Transformers library by HuggingFace.☆10,852Updated this week
- An unnecessarily tiny implementation of GPT-2 in NumPy.☆3,353Updated 2 years ago
- LLM101n: Let's build a Storyteller☆33,399Updated 9 months ago
- NanoGPT (124M) in 3 minutes☆2,533Updated 2 weeks ago
- Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)☆8,903Updated 2 weeks ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆10,423Updated 11 months ago
- Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023☆2,836Updated last month
- If tinygrad wasn't small enough for you...☆718Updated last year
- Tensor library for machine learning☆12,477Updated this week
- PyTorch native post-training library☆5,171Updated this week
- MLX: An array framework for Apple silicon☆20,509Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆8,693Updated this week
- Solve puzzles. Improve your pytorch.☆3,554Updated 9 months ago
- Solve puzzles. Learn CUDA.☆10,970Updated 8 months ago
- Development repository for the Triton language and compiler☆15,504Updated this week
- An API standard for single-agent reinforcement learning environments, with popular reference environments and related utilities (formerly…☆9,091Updated this week
- Flax is a neural network library for JAX that is designed for flexibility.☆6,539Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆5,946Updated last month