Alternatives and similar repositories for transformers_from_scratch

Users that are interested in transformers_from_scratch are comparing it to the libraries listed below

• REXWindW / my_llm
  尝试自己从头写一个LLM，参考llama和nanogpt
  ☆68Updated last year
• zhaibowen / Retriever
  Retriever-0.1B
  ☆95Updated last year
• AI-Study-Han / Zero-Chatgpt
  从0开始，将chatgpt的技术路线跑一遍。
  ☆268Updated last year
• liguodongiot / unify-easy-llm
  unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
  ☆59Updated last year
• owenliang / chatgpt
  simple decoder-only GTP model in pytorch
  ☆43Updated last year
• cwxndl / LLM
  大语言模型应用：RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛
  ☆74Updated 10 months ago
• bbruceyuan / LLMs-101
  从零到一实现一个 miniLLM～（动手学习LLM）
  ☆76Updated last year
• SmartFlowAI / LLM101n-CN
  LLM101n: Let's build a Storyteller 中文版
  ☆136Updated last year
• owenliang / qwen-vllm
  通义千问VLLM推理部署DEMO
  ☆633Updated last year
• Tongjilibo / build_MiniLLM_from_scratch
  从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)
  ☆505Updated 9 months ago
• KMnO4-zx / TinyAgent
  基于ReAct手搓一个Agent Demo
  ☆159Updated 5 months ago
• charent / Phi2-mini-Chinese
  Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型，支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
  ☆580Updated last year
• KMnO4-zx / TinyRAG
  TinyRAG
  ☆383Updated 5 months ago
• datawhalechina / unlock-deepseek
  DeepSeek 系列工作解读、扩展和复现。
  ☆691Updated 8 months ago
• OpenBMB / MiniCPM-CookBook
  This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…
  ☆295Updated 5 months ago
• Mxoder / LLM-from-scratch
  一些 LLM 方面的从零复现笔记
  ☆239Updated 7 months ago
• open-chinese / alpaca-chinese-dataset
  Alpaca Chinese Dataset -- 中文指令微调数据集
  ☆217Updated last year
• mobvoi / seq-monkey-data
  ☆170Updated last year
• waylandzhang / DeepSeek-RL-Qwen-0.5B-GRPO-gsm8k
  ☆85Updated 10 months ago
• Sshuoshuo / easy-rag
  快速入门RAG与私有化部署
  ☆211Updated last year
• zjrwtx / SFT-data-builder
  利用免费的大模型api来结合你的私域数据来生成sft训练数据（妥妥白嫖）支持llamafactory等工具的训练数据格式synthetic data
  ☆190Updated last year
• datawhalechina / llm-deploy
  大模型/LLM推理和部署理论与实践
  ☆368Updated 5 months ago
• BUAADreamer / EasyRAG
  Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案
  ☆602Updated last year
• zhanshijinwat / Steel-LLM
  Train a 1B LLM with 1T tokens from scratch by personal
  ☆772Updated 7 months ago
• Nipi64310 / RAG-Book
  本项目为书籍《大模型RAG实战》的代码以及资料汇总。
  ☆265Updated last year
• jiahe7ay / MINI_LLM
  This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
  ☆483Updated 7 months ago
• SmartFlowAI / Llama3-Tutorial
  Llama3-Tutorial（XTuner、LMDeploy、OpenCompass）
  ☆511Updated last year
• MetaGLM / OpenLM
  本项目致力于为大模型领域的初学者提供全面的知识体系，包括基础和高阶内容，以便开发者能迅速掌握大模型技术栈并全面了解相关知识。
  ☆62Updated 11 months ago
• liucongg / LLMsBook
  大型语言模型实战指南：应用实践与场景落地
  ☆83Updated last year
• AXYZdong / AMchat
  AM (Advanced Mathematics) Chat is a large language model that integrates advanced mathematical knowledge, exercises in higher mathematics…
  ☆225Updated last year