rasbt / LLMs-from-scratchLinks
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
☆79,335Updated this week
Alternatives and similar repositories for LLMs-from-scratch
Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below
Sorting:
- 22AVP103 - Mastery Over Mind: 1st Sem B.Tech CSE (CYS) - ASC, CBE☆33Updated last week
- llama3 implementation one matrix multiplication at a time☆15,189Updated last year
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆68,098Updated 5 months ago
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆17,990Updated 4 months ago
- 仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理☆3,743Updated last year
- Awesome-LLM: a curated list of Large Language Model☆25,612Updated 4 months ago
- LLM101n: Let's build a Storyteller☆35,689Updated last year
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek-R1, Qwen3, Gemma 3, TTS 2x faster with 70% less VRAM.☆48,542Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆63,667Updated last week
- This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information r…☆23,165Updated 3 weeks ago
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆62,973Updated this week
- Simple, unified interface to multiple Generative AI providers☆12,831Updated 2 weeks ago
- 21 Lessons, Get Started Building with Generative AI☆102,095Updated last week
- 《Build a Large Language Model (From Scratch)》是一本深入探讨大语言模型原理与实现的电子书，适合希望深入了解 GPT 等大模型架构、训练过程及应用开发的学习者。为了让更多中文读者能够接触到这本极具价值的教材，我决定将其翻译成中文，并…☆2,672Updated 2 months ago
- [WIP] Resources for AI engineers. Also contains supporting materials for the book AI Engineering (Chip Huyen, 2025)☆11,349Updated 9 months ago
- 🌐 Make websites accessible for AI agents. Automate tasks online with ease.☆72,835Updated this week
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆12,975Updated this week
- A programming framework for agentic AI☆51,918Updated last month
- 12 Lessons to Get Started Building AI Agents☆45,391Updated last week
- Get up and running with OpenAI gpt-oss, DeepSeek-R1, Gemma 3 and other models.☆156,481Updated last week
- In-depth tutorials on LLMs, RAGs and real-world AI agent applications.☆21,080Updated last week
- Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work t…☆40,681Updated last week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆29,384Updated this week
- LLM training in simple, raw C/CUDA☆28,257Updated 5 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆49,869Updated 2 weeks ago
- Understanding Deep Learning - Simon J.D. Prince☆8,510Updated last week
- 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.☆66,710Updated last week
- DSPy: The framework for programming—not prompting—language models☆30,167Updated last week
- We write your reusable computer vision tools. 💜☆36,019Updated this week
- 🙌 OpenHands: Code Less, Make More☆65,144Updated last week