Alternatives and similar repositories for LLMs-from-Scratch

Users that are interested in LLMs-from-Scratch are comparing it to the libraries listed below

• JohnMachado11 / Build-a-Large-Language-Model-from-Scratch
  Building a GPT-like LLM from scratch with PyTorch.
  ☆327Updated last year
• FareedKhan-dev / train-llm-from-scratch
  A straightforward method for training your LLM, from downloading data to generating text.
  ☆503Updated 5 months ago
• rasbt / reasoning-from-scratch
  Implement a reasoning LLM in PyTorch from scratch, step by step
  ☆2,416Updated this week
• ImadSaddik / Train_Your_Language_Model_Course
  Train a language model to chat like you using your personal conversations from WhatsApp, Telegram, Signal, or other platforms.
  ☆241Updated 3 months ago
• YuvrajSingh-mist / NeatRL
  Repository of implementations of classic and sota rl algorithms from scratch in PyTorch
  ☆216Updated last week
• KalyanKS-NLP / LLM-Survey-Papers-Collection
  A category wise collection of 200+ LLM survey papers.
  ☆264Updated 9 months ago
• PacktPublishing / Building-LLM-Powered-Applications
  Building Large Language Model Applications, Published by Packt
  ☆380Updated last month
• mrdbourke / learn-huggingface
  Repo designed to help learn the Hugging Face ecosystem (transformers, datasets, accelerate + more).
  ☆138Updated this week
• YuvrajSingh-mist / Paper-Replications
  A repository consisting of paper/architecture replications of classic/SOTA AI/ML papers in pytorch
  ☆399Updated 2 months ago
• youssefHosni / Hands-On-LLM-Fine-Tuning
  Hands-on tutorials on fine-tuning various LLMs using different fine-tuning techniques
  ☆358Updated 6 months ago
• PacktPublishing / Modern-AI-Agents
  Modern AI Agents
  ☆225Updated last week
• analyticalrohit / AI-ML-Cheatsheets
  All Stanford Cheatsheets: Artificial Intelligence, Transformers, LLMs, Deep Learning, Machine Learning, Probabilities, Statistics, Algebr…
  ☆786Updated last week
• FareedKhan-dev / create-million-parameter-llm-from-scratch
  Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.
  ☆196Updated last year
• FareedKhan-dev / gpt4o-from-scratch
  Implementation of a GPT-4o like Multimodal from Scratch using Python
  ☆75Updated 9 months ago
• swirl-ai / ai-angineers-handbook
  ☆659Updated 10 months ago
• markhliu / DGAI
  Learn Generative AI with PyTorch (Manning Publications, 2024)
  ☆133Updated 7 months ago
• KalyanKS-NLP / rag-zero-to-hero-guide
  Comprehensive guide to learn RAG from basics to advanced.
  ☆1,213Updated 9 months ago
• hkproj / transformer-from-scratch-notes
  Notes about "Attention is all you need" video (https://www.youtube.com/watch?v=bCz4OMemCcA)
  ☆333Updated 2 years ago
• vossenwout / llm-finetuning-resources
  Unsloth fine-tuning resources.
  ☆77Updated 9 months ago
• jamwithai / local-rag-system
  ☆260Updated 6 months ago
• towardsai / ragbook-notebooks
  Repository for the "Building LLMs for Production" book by Towards AI.
  ☆520Updated last year
• PacktPublishing / Generative-AI-with-Python-and-PyTorch-Second-Edition
  Generative AI with Python and PyTorch , Second Edition - Published by Packt
  ☆156Updated 4 months ago
• FareedKhan-dev / Building-llama3-from-scratch
  LLaMA 3 is one of the most promising open-source model after Mistral, we will recreate it's architecture in a simpler manner.
  ☆196Updated last year
• vivekkalyanarangan30 / llm_from_scratch
  ☆823Updated 2 months ago
• Mayankpratapsingh022 / DeepSeek-from-Scratch
  ☆70Updated 6 months ago
• peggy1502 / Amazing-Resources
  List of references and online resources related to data science, machine learning and deep learning.
  ☆414Updated 3 months ago
• Denis2054 / Context-Engineering-for-Multi-Agent-Systems
  This repository provides the companion Jupyter Notebooks for the book Context-Engineering for Multi-Agent Systems. It technically details…
  ☆112Updated 2 weeks ago
• The-Pocket / PocketFlow-Tutorial-Video-Generator
  ☆75Updated last month
• the-ai-merge / multimodal-agents-course
  An MCP Multimodal AI Agent with eyes and ears!
  ☆520Updated last week
• neural-maze / philoagents-course
  When Philosophy meets AI
  ☆1,427Updated 2 months ago