Alternatives and similar repositories for LLMs-from-scratch

Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below

• naklecha / llama3-from-scratch
  llama3 implementation one matrix multiplication at a time
  ☆14,982Updated last year
• mendableai / firecrawl
  🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
  ☆38,945Updated this week
• Hannibal046 / Awesome-LLM
  Awesome-LLM: a curated list of Large Language Model
  ☆23,478Updated 3 weeks ago
• huggingface / open-r1
  Fully open reproduction of DeepSeek-R1
  ☆24,541Updated this week
• QwenLM / Qwen3
  Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.
  ☆21,673Updated last week
• deepseek-ai / DeepSeek-V3
  ☆97,276Updated last month
• langchain-ai / langchain
  🦜🔗 Build context-aware reasoning applications
  ☆108,279Updated this week
• hiyouga / LLaMA-Factory
  Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
  ☆50,485Updated last week
• QwenLM / Qwen
  The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
  ☆18,358Updated last month
• deepseek-ai / DeepSeek-R1
  ☆89,464Updated last month
• vllm-project / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆48,531Updated this week
• unslothai / unsloth
  Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥
  ☆39,558Updated this week
• HandsOnLLM / Hands-On-Large-Language-Models
  Official code repo for the O'Reilly Book - "Hands-On Large Language Models"
  ☆9,066Updated last month
• VikParuchuri / marker
  Convert PDF to markdown + JSON quickly with high accuracy
  ☆25,396Updated this week
• datawhalechina / llms-from-scratch-cn
  仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理
  ☆3,108Updated 9 months ago
• deepseek-ai / DeepSeek-Coder
  DeepSeek Coder: Let the Code Write Itself
  ☆21,618Updated last year
• Lightning-AI / litgpt
  20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
  ☆12,174Updated this week
• deepseek-ai / awesome-deepseek-integration
  Integrate the DeepSeek API into popular softwares
  ☆32,548Updated 2 weeks ago
• meta-llama / llama3
  The official Meta Llama 3 GitHub site
  ☆28,740Updated 4 months ago
• karpathy / LLM101n
  LLM101n: Let's build a Storyteller
  ☆33,506Updated 9 months ago
• deepseek-ai / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models
  ☆17,306Updated 3 months ago
• karpathy / llm.c
  LLM training in simple, raw C/CUDA
  ☆26,706Updated 3 weeks ago
• run-llama / llama_index
  LlamaIndex is the leading framework for building LLM-powered agents over your data.
  ☆41,989Updated this week
• stanford-oval / storm
  An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.
  ☆24,399Updated 3 weeks ago
• microsoft / graphrag
  A modular graph-based Retrieval-Augmented Generation (RAG) system
  ☆25,439Updated last week
• lm-sys / FastChat
  An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
  ☆38,670Updated last week
• meta-llama / llama
  Inference code for Llama models
  ☆58,290Updated 4 months ago
• mlabonne / llm-course
  Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
  ☆52,817Updated 2 weeks ago
• karpathy / minbpe
  Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
  ☆9,662Updated 10 months ago
• hpcaitech / Open-Sora
  Open-Sora: Democratizing Efficient Video Production for All
  ☆26,530Updated last month