Antimatter543 / karpathy-NN-lectures
My runthrough of karpathy's lectures (with notes), building NN's from scratch, simple autoregressive language models, GPT models and learnt ML techniques.
☆10Updated last year
Related projects: ⓘ
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆29Updated last year
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆42Updated last year
- Simple Transformer in Jax☆100Updated 2 months ago
- ☆27Updated 2 months ago
- KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…☆23Updated 10 months ago
- ☆18Updated last month
- ☆22Updated last year
- Fast inference of Instruct tuned LLaMa on your personal devices.☆22Updated last year
- A single notebook for fine-tuning GPT-3.5 turbo☆29Updated last month
- ☆55Updated 9 months ago
- inference code for mixtral-8x7b-32kseqlen☆97Updated 9 months ago
- Stream of my favorite papers and links☆34Updated 2 weeks ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆81Updated last year
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆23Updated 5 months ago
- small auto-grad engine inspired from Karpathy's micrograd and PyTorch☆91Updated 2 months ago
- ☆48Updated 11 months ago
- A synthetic story narration dataset to study small audio LMs.☆28Updated 8 months ago
- Helpers and such for working with Lambda Cloud☆51Updated 10 months ago
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆60Updated 4 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 weeks ago
- 1.58 Bit LLM on Apple Silicon using MLX☆97Updated 4 months ago
- A really tiny autograd engine☆85Updated 5 months ago
- A puzzle to learn about prompting☆106Updated last year
- papers.day☆80Updated 9 months ago
- Video+code lecture on building nanoGPT from scratch☆64Updated 3 months ago
- LLM training in simple, raw C/CUDA☆17Updated 4 months ago
- Jax like function transformation engine but micro, microjax☆24Updated 3 weeks ago
- run embeddings in MLX☆68Updated last month
- An implementation of delta-iris in tinygrad☆67Updated last month
- could we make an ml stack in 100,000 lines of code?☆22Updated 2 months ago