rasbt / LLMs-from-scratchLinks
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
☆59,443Updated last week
Alternatives and similar repositories for LLMs-from-scratch
Users that are interested in LLMs-from-scratch are comparing it to the libraries listed below
Sorting:
- Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.☆57,824Updated last month
- llama3 implementation one matrix multiplication at a time☆15,050Updated last year
- LLM101n: Let's build a Storyteller☆34,055Updated 11 months ago
- 仅需Python基础,从0构建大语言模型;从0逐步构建GLM4\Llama3\RWKV6, 深入理解大模型原理☆3,342Updated 11 months ago
- An LLM-powered knowledge curation system that researches a topic and generates a full-length report with citations.☆26,959Updated 3 weeks ago
- The official GitHub page for the survey paper "A Survey of Large Language Models".☆11,694Updated 4 months ago
- 20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.☆12,547Updated this week
- Awesome-LLM: a curated list of Large Language Model☆24,321Updated this week
- A modular graph-based Retrieval-Augmented Generation (RAG) system☆26,742Updated this week
- Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.☆9,772Updated last year
- Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)☆54,711Updated this week
- LLM training in simple, raw C/CUDA☆27,216Updated 3 weeks ago
- A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)☆9,991Updated last year
- Machine Learning Engineering Open Book☆14,454Updated last week
- Official code repo for the O'Reilly Book - "Hands-On Large Language Models"☆13,119Updated this week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆43,152Updated 7 months ago
- Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We als…☆17,654Updated this week
- Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train Qwen3, Llama 4, DeepSeek-R1, Gemma 3, TTS 2x faster with 70% less VRAM.☆42,597Updated this week
- This repository contains demos I made with the Transformers library by HuggingFace.☆11,102Updated 3 weeks ago
- A one stop repository for generative AI research updates, interview resources, notebooks and much more!☆13,438Updated last month
- A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/aut…