Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
☆86,149Feb 19, 2026Updated last week
Alternatives and similar repositories for LLMs-from-scratch
Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below
Sorting:
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆75,865Feb 5, 2026Updated 3 weeks ago
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.☆52,724Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆71,234Updated this week
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆67,659Updated this week
- LLM101n: Let's build a Storyteller☆36,390Aug 1, 2024Updated last year
- llama3 implementation one matrix multiplication at a time☆15,243May 23, 2024Updated last year
- 21 Lessons, Get Started Building with Generative AI☆107,022Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆53,743Nov 12, 2025Updated 3 months ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆163,632Updated this week
- 🦜🔗 The platform for reliable agents.☆127,809Updated this week
- 🙌 OpenHands: AI-Driven Development☆68,154Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,182Feb 22, 2026Updated last week
- LLM training in simple, raw C/CUDA☆28,940Jun 26, 2025Updated 8 months ago
- LLM inference in C/C++☆95,726Updated this week
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆23,021Dec 17, 2025Updated 2 months ago
- Universal memory layer for AI Agents☆47,994Feb 23, 2026Updated last week
- Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.☆97,908Updated this week
- Production-ready platform for agentic workflow development.☆130,750Updated this week
- A programming framework for agentic AI☆54,956Jan 22, 2026Updated last month
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆70,881Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆157,071Updated this week
- Build, run, manage agentic software at scale.☆38,276Updated this week
- LlamaIndex is the leading document agent and OCR platform☆47,210Updated this week
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆73,900Updated this week
- DSPy: The framework for programming—not prompting—language models☆32,381Updated this week
- 仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理☆3,968Aug 15, 2024Updated last year
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆31,031Feb 20, 2026Updated last week
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆27,918Sep 30, 2025Updated 5 months ago
- 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming☆64,377Jan 21, 2026Updated last month
- Machine Learning Engineering Open Book☆17,162Feb 21, 2026Updated last week
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,220Nov 3, 2025Updated 3 months ago
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆79,028Updated this week
- A natural language interface for computers☆62,427Feb 9, 2026Updated 3 weeks ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆41,706Updated this week
- Awesome-LLM: a curated list of Large Language Model☆26,330Jul 31, 2025Updated 7 months ago
- Examples and guides for using the OpenAI API☆71,720Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆124,763Updated this week
- 🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data☆84,899Feb 22, 2026Updated last week
- The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builder, MCP compatibility, and more.☆55,217Updated this week