karpathy / build-nanogpt

Related projects ⓘ

Alternatives and complementary repositories for build-nanogpt

• EurekaLabsAI / ngram
  The n-gram Language Model
  ☆1,342Updated 3 months ago
• karpathy / nano-llama31
  nanoGPT style version of Llama 3.1
  ☆1,246Updated 3 months ago
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,195Updated 4 months ago
• mlabonne / llm-datasets
  High-quality datasets, tools, and concepts for LLM fine-tuning.
  ☆2,010Updated 3 weeks ago
• KellerJordan / modded-nanogpt
  NanoGPT (124M) quality in 7.8 8xH100-minutes
  ☆1,033Updated this week
• pytorch / torchtune
  PyTorch native finetuning library
  ☆4,336Updated this week
• NirDiamant / RAG_Techniques
  This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information r…
  ☆8,671Updated last week
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆10,734Updated last week
• karpathy / makemore
  An autoregressive character-level language model for making more things
  ☆2,607Updated 5 months ago
• mistralai / mistral-finetune
  ☆2,746Updated 2 months ago
• pytorch / torchtitan
  A native PyTorch Library for large model training
  ☆2,623Updated this week
• EurekaLabsAI / mlp
  The Multilayer Perceptron Language Model
  ☆523Updated 3 months ago
• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆13,741Updated 5 months ago
• srush / Tensor-Puzzles
  Solve puzzles. Improve your pytorch.
  ☆3,282Updated 4 months ago
• EurekaLabsAI / micrograd
  The Autograd Engine
  ☆534Updated 2 months ago
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆24,460Updated last month
• karpathy / LLM101n
  LLM101n: Let's build a Storyteller
  ☆30,214Updated 3 months ago
• hijkzzz / Awesome-LLM-Strawberry
  A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 and reasoning techniques.
  ☆5,211Updated this week
• linkedin / Liger-Kernel
  Efficient Triton Kernels for LLM Training
  ☆3,454Updated this week
• pytorch-labs / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆5,669Updated last month
• openai / transformer-debugger
  ☆4,035Updated 5 months ago
• mlfoundations / dclm
  DataComp for Language Models
  ☆1,157Updated this week
• facebookresearch / lingua
  Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.
  ☆4,227Updated last week
• decodingml / llm-twin-course
  🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽�…
  ☆2,850Updated this week
• rasbt / LLM-workshop-2024
  A 4-hour coding workshop to understand how LLMs are implemented and used
  ☆752Updated 2 months ago
• HandsOnLLM / Hands-On-Large-Language-Models
  Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
  ☆2,281Updated last month
• pytorch / torchchat
  Run PyTorch LLMs locally on servers, desktop and mobile
  ☆3,383Updated this week
• karpathy / ng-video-lecture
  ☆3,570Updated 9 months ago
• run-llama / llama_parse
  Parse files for optimal RAG
  ☆3,173Updated last week
• ashishpatel26 / LLM-Finetuning
  LLM Finetuning with peft
  ☆2,164Updated 4 months ago