rasbt / LLMs-from-scratchLinks
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
☆59,443Updated last week
Alternatives and similar repositories for LLMs-from-scratch
Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below
Sorting:
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆57,824Updated last month
- llama3 implementation one matrix multiplication at a time☆15,050Updated last year
- LLM101n: Let's build a Storyteller☆34,055Updated 11 months ago
- 仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理☆3,342Updated 11 months ago
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆26,959Updated 3 weeks ago
- The official GitHub page for the survey paper "A Survey of Large Language Models".☆11,694Updated 4 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆12,547Updated this week
- Awesome-LLM: a curated list of Large Language Model☆24,321Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆26,742Updated this week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆9,772Updated last year
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆54,711Updated this week
- LLM training in simple, raw C/CUDA☆27,216Updated 3 weeks ago
- A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)☆9,991Updated last year
- Machine Learning Engineering Open Book☆14,454Updated last week
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆13,119Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆43,152Updated 7 months ago
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,654Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.☆42,597Updated this week
- This repository contains demos I made with the Transformers library by HuggingFace.☆11,102Updated 3 weeks ago
- A one stop repository for generative AI research updates, interview resources, notebooks and much more!☆13,438Updated last month
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…☆47,688Updated this week
- 🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!☆23,419Updated 2 months ago
- 《Build a Large Language Model (From Scratch)》是一本深入探讨大语言模型原理与实现的电子书，适合希望深入了解 GPT 等大模型架构、训练过程及应用开发的学习者。为了让更多中文读者能够接触到这本极具价值的教材，我决定将其翻译成中文，并…☆1,933Updated this week
- A playbook for systematically maximizing the performance of deep learning models.☆28,953Updated last year
- Approaching (Almost) Any Machine Learning Problem☆8,013Updated 2 years ago
- 本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）☆19,631Updated 2 weeks ago
- Understanding Deep Learning - Simon J.D. Prince☆7,665Updated 2 weeks ago
- 21 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/☆92,030Updated last week
- 《动手学大模型Dive into LLMs》系列编程实践教程☆7,085Updated last week
- DSPy: The framework for programming—not prompting—language models☆26,664Updated this week