Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
☆88,603Mar 7, 2026Updated 2 weeks ago
Alternatives and similar repositories for LLMs-from-scratch
Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below
Sorting:
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆77,102Feb 5, 2026Updated last month
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆54,096Updated this week
- LLM101n: Let's build a Storyteller☆36,559Aug 1, 2024Updated last year
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆68,728Updated this week
- 仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理☆4,023Aug 15, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆73,479Updated this week
- llama3 implementation one matrix multiplication at a time☆15,252May 23, 2024Updated last year
- 21 Lessons, Get Started Building with Generative AI☆108,144Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆55,030Nov 12, 2025Updated 4 months ago
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆24,079Dec 17, 2025Updated 3 months ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆165,557Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,228Mar 6, 2026Updated 2 weeks ago
- The agent engineering platform☆130,454Updated this week
- LLM training in simple, raw C/CUDA☆29,216Jun 26, 2025Updated 8 months ago
- 🙌 OpenHands: AI-Driven Development☆69,254Updated this week
- Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.☆102,903Updated this week
- LLM inference in C/C++☆98,098Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆158,060Updated this week
- Production-ready platform for agentic workflow development.☆133,787Updated this week
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆71,923Mar 11, 2026Updated last week
- Universal memory layer for AI Agents☆50,147Updated this week
- A programming framework for agentic AI☆55,908Updated this week
- Build, run, manage agentic software at scale.☆38,835Updated this week
- Machine Learning Engineering Open Book☆17,440Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆31,474Mar 15, 2026Updated last week
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆75,590Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,853Updated this week
- LlamaIndex is the leading document agent and OCR platform☆47,753Updated this week
- 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming☆65,185Jan 21, 2026Updated 2 months ago
- Awesome-LLM: a curated list of Large Language Model☆26,488Jul 31, 2025Updated 7 months ago
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆28,006Sep 30, 2025Updated 5 months ago
- 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!☆41,349Feb 6, 2026Updated last month
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,261Mar 3, 2026Updated 2 weeks ago
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆81,169Updated this week
- Master programming by recreating your favorite technologies from scratch.☆475,264Feb 21, 2026Updated last month
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,869Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆127,399Updated this week
- A natural language interface for computers☆62,780Feb 9, 2026Updated last month
- 🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, fee…☆66,064Jan 22, 2026Updated 2 months ago