Alternatives and similar repositories for llama3-from-scratch

Users that are interested in llama3-from-scratch are comparing it to the libraries listed below

• stas00 / ml-engineering
  Machine Learning Engineering Open Book
  ☆15,880Updated 2 weeks ago
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆10,195Updated last year
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆13,000Updated this week
• openai / transformer-debugger
  ☆4,110Updated last year
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆28,325Updated 5 months ago
• meta-pytorch / gpt-fast
  Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
  ☆6,162Updated 3 months ago
• allenai / OLMo
  Modeling, training, eval, and inference code for OLMo
  ☆6,197Updated last week
• karpathy / build-nanogpt
  Video+code lecture on building nanoGPT from scratch
  ☆4,584Updated last year
• huggingface / peft
  🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
  ☆20,157Updated 2 weeks ago
• rasbt / LLMs-from-scratch
  Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
  ☆80,136Updated last week
• WooooDyy / LLM-Agent-Paper-List
  The paper list of the 86-page SCIS cover paper "The Rise and Potential of Large Language Model Based Agents: A Survey" by Zhiheng Xi et a…
  ☆7,993Updated 2 months ago
• hijkzzz / Awesome-LLM-Strawberry
  A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.
  ☆6,854Updated last month
• bbycroft / llm-viz
  3D Visualization of an GPT-style LLM
  ☆5,134Updated last year
• meta-pytorch / torchtune
  PyTorch native post-training library
  ☆5,608Updated this week
• mlabonne / llm-course
  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
  ☆68,888Updated 6 months ago
• huggingface / trl
  Train transformer language models with reinforcement learning.
  ☆16,473Updated last week
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆50,264Updated 3 weeks ago
• Hannibal046 / Awesome-LLM
  Awesome-LLM: a curated list of Large Language Model
  ☆25,681Updated 4 months ago
• axolotl-ai-cloud / axolotl
  Go ahead and axolotl questions
  ☆10,870Updated this week
• jzhang38 / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆8,816Updated last year
• unslothai / unsloth
  Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.
  ☆48,786Updated last week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆64,235Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,995Updated last year
• Mooler0410 / LLMsPracticalGuide
  A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)
  ☆10,111Updated last year
• LargeWorldModel / LWM
  Large World Model -- Modeling Text and Video with Millions Context
  ☆7,380Updated last year
• ggml-org / ggml
  Tensor library for machine learning
  ☆13,648Updated last week
• Jiayi-Pan / TinyZero
  Minimal reproduction of DeepSeek R1-Zero
  ☆12,444Updated 7 months ago
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆18,061Updated last month
• dair-ai / ML-Papers-of-the-Week
  🔥Highlighting the top ML papers every week.
  ☆12,125Updated 4 months ago
• karpathy / minGPT
  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
  ☆23,075Updated last year