Antimatter543 / karpathy-NN-lectures
My runthrough of karpathy's lectures (with notes), building NN's from scratch, simple autoregressive language models, GPT models and learnt ML techniques.
☆10Updated last year
Alternatives and similar repositories for karpathy-NN-lectures:
Users that are interested in karpathy-NN-lectures are comparing it to the libraries listed below
- Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.☆44Updated last year
- A repository of prompts and Python scripts for intelligent transformation of raw text into diverse formats.☆30Updated last year
- ☆27Updated 6 months ago
- ☆22Updated last year
- This repo is my attempt at a rough implementation of nanoGPT trained on a dataset of 30,000 unique Twitter usernames☆26Updated 9 months ago
- Sparse autoencoders for Contra text embedding models☆25Updated 9 months ago
- MLX Transformers is a library that provides model implementation in MLX. It uses a similar model interface as HuggingFace Transformers an…☆58Updated 2 months ago
- ☆21Updated 6 months ago
- Comprehensive analysis of difference in performance of QLora, Lora, and Full Finetunes.☆82Updated last year
- inference code for mixtral-8x7b-32kseqlen☆99Updated last year
- ☆98Updated 9 months ago
- Andrej Kapathy's micrograd implemented in c☆29Updated 5 months ago
- ☆13Updated last year
- ☆48Updated last year
- Simple Transformer in Jax☆134Updated 7 months ago
- run embeddings in MLX☆81Updated 4 months ago
- A synthetic story narration dataset to study small audio LMs.☆31Updated last year
- ☆52Updated 9 months ago
- A miniature version of Modal☆19Updated 7 months ago
- Fully fine-tune large models like Mistral, Llama-2-13B, or Qwen-14B completely for free☆225Updated 3 months ago
- Video+code lecture on building nanoGPT from scratch☆65Updated 7 months ago
- ☆14Updated 6 months ago
- new optimizer☆19Updated 5 months ago
- a tiny vectorstore implementation built with numpy.☆60Updated 9 months ago
- ☆22Updated 3 months ago
- An introduction to LLM Sampling☆75Updated last month
- Public reports detailing responses to sets of prompts by Large Language Models.☆29Updated 3 weeks ago
- This repository contains the code for dataset curation and finetuning of instruct variant of the Bilingual OpenHathi model. The resultin…☆23Updated last year
- Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.☆59Updated 8 months ago