Alternatives and similar repositories for LLMs-from-scratch:

Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below

• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆14,285Updated 10 months ago
• karpathy / nanoGPT
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆40,237Updated 3 months ago
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆11,841Updated this week
• karpathy / LLM101n
  LLM101n: Let's build a Storyteller
  ☆32,926Updated 7 months ago
• meta-llama / llama-cookbook
  Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…
  ☆16,515Updated last week
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,502Updated 8 months ago
• microsoft / graphrag
  A modular graph-based Retrieval-Augmented Generation (RAG) system
  ☆23,734Updated this week
• unslothai / unsloth
  Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥
  ☆35,466Updated this week
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆26,079Updated 5 months ago
• langchain-ai / langchain
  🦜🔗 Build context-aware reasoning applications
  ☆104,206Updated this week
• HandsOnLLM / Hands-On-Large-Language-Models
  Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
  ☆5,740Updated last month
• geekan / MetaGPT
  🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
  ☆53,110Updated this week
• datawhalechina / llms-from-scratch-cn
  仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理
  ☆2,532Updated 7 months ago
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆40,273Updated this week
• deepseek-ai / DeepSeek-V3
  ☆92,852Updated last week
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆42,344Updated this week
• meta-llama / llama3
  The official Meta Llama 3 GitHub site
  ☆28,537Updated last month
• letta-ai / letta
  Letta (formerly MemGPT) is the stateful agents framework with memory, reasoning, and context management.
  ☆15,573Updated this week
• Hannibal046 / Awesome-LLM
  Awesome-LLM: a curated list of Large Language Model
  ☆22,273Updated last week
• hpcaitech / Open-Sora
  Open-Sora: Democratizing Efficient Video Production for All
  ☆25,800Updated this week
• deepseek-ai / DeepSeek-R1
  ☆87,317Updated last month
• hiyouga / LLaMA-Factory
  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
  ☆45,117Updated this week
• poloclub / transformer-explainer
  Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
  ☆4,135Updated this week
• karpathy / llama2.c
  Inference Llama 2 in one file of pure C
  ☆18,196Updated 7 months ago
• openai / tiktoken
  tiktoken is a fast BPE tokeniser for use with OpenAI's models.
  ☆13,898Updated last week
• SakanaAI / AI-Scientist
  The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬
  ☆10,370Updated this week
• mem0ai / mem0
  The Memory layer for AI Agents
  ☆26,530Updated this week
• mendableai / firecrawl
  🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
  ☆31,990Updated this week
• stanford-oval / storm
  An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.
  ☆23,520Updated 2 months ago
• sgl-project / sglang
  SGLang is a fast serving framework for large language models and vision language models.
  ☆12,427Updated this week