Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
☆91,948Apr 16, 2026Updated 3 weeks ago
Alternatives and similar repositories for LLMs-from-scratch
Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆79,075Feb 5, 2026Updated 3 months ago
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.☆63,952Updated this week
- LLM101n: Let's build a Storyteller☆36,894Aug 1, 2024Updated last year
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆70,969May 3, 2026Updated last week
- 仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理☆4,136Mar 26, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A high-throughput and memory-efficient inference and serving engine for LLMs☆78,979May 4, 2026Updated last week
- llama3 implementation one matrix multiplication at a time☆15,246May 23, 2024Updated last year
- 21 Lessons, Get Started Building with Generative AI☆110,630Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆57,846Nov 12, 2025Updated 5 months ago
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆26,171Apr 24, 2026Updated 2 weeks ago
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆170,820Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆13,349May 1, 2026Updated last week
- The agent engineering platform. Available in TypeScript!☆136,191Updated this week
- LLM training in simple, raw C/CUDA☆29,842Jun 26, 2025Updated 10 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🙌 OpenHands: AI-Driven Development☆73,120Updated this week
- 100+ AI Agent & RAG apps you can actually run — clone, customize, ship.☆109,087May 4, 2026Updated last week
- LLM inference in C/C++☆109,291Updated this week
- 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal model…☆160,288Updated this week
- Production-ready platform for agentic workflow development.☆140,588Updated this week
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆74,239Mar 11, 2026Updated 2 months ago
- Universal memory layer for AI Agents☆55,385Updated this week
- A programming framework for agentic AI☆57,766Apr 15, 2026Updated 3 weeks ago
- Machine Learning Engineering Open Book☆17,854Mar 16, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Build, run, and manage agent platforms.☆40,013Updated this week
- DSPy: The framework for programming—not prompting—language models☆34,327Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆32,860Updated this week
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆79,944Updated this week
- LlamaIndex is the leading document agent and OCR platform☆49,127May 4, 2026Updated last week
- 🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming☆67,816Jan 21, 2026Updated 3 months ago
- Awesome-LLM: a curated list of Large Language Model☆26,735Jul 31, 2025Updated 9 months ago
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆28,180Sep 30, 2025Updated 7 months ago
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆18,318Apr 21, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🧠「大模型」2小时完全从0 训练64M的小参数LLM！Train a 64M-parameter LLM from scratch in just 2h!☆49,407Updated this week
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆92,144May 5, 2026Updated last week
- Master programming by recreating your favorite technologies from scratch.☆500,020Feb 21, 2026Updated 2 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆42,281Updated this week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆136,384Updated this week
- 🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, fee…☆66,563Jan 22, 2026Updated 3 months ago
- A natural language interface for computers☆63,389May 4, 2026Updated last week