bbruceyuan / LLMs-101
从零到一实现一个 miniLLM~(动手学习LLM)
☆64Updated 11 months ago
Alternatives and similar repositories for LLMs-101:
Users that are interested in LLMs-101 are comparing it to the libraries listed below
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆419Updated 2 weeks ago
- 从0开始,将chatgpt的技术路线跑一遍。☆228Updated 7 months ago
- 一个很小很小的RAG系统☆195Updated 4 months ago
- 一些 LLM 方面的从零复现笔记☆181Updated 6 months ago
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆415Updated 3 weeks ago
- ☆62Updated last year
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆312Updated 8 months ago
- 使用单个24G显卡,从0开始训练LLM☆52Updated 5 months ago
- ☆107Updated 5 months ago
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆350Updated last month
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆193Updated 10 months ago
- 本项目致力于为大模型领域的初学者提供全面的知识体系,包括基础和高阶内容,以便开发者能迅速掌握大模型技术栈并全面了解相关知识。☆54Updated 3 months ago
- TinyRAG☆284Updated 5 months ago
- ☆77Updated 4 months ago
- 怎么训练一个LLM分词器☆143Updated last year
- ☆30Updated 6 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 8 months ago
- Huggingface transformers的中文文档☆228Updated last year
- 对llama3进行全参微调、lora微调以及qlora微调。☆192Updated 6 months ago
- 大模型/LLM推理和部署理论与实践☆237Updated last month
- Alpaca Chinese Dataset -- 中文指令微调数据集☆195Updated 6 months ago
- 看图学大模型☆285Updated 8 months ago
- DeepSpeed Tutorial☆95Updated 8 months ago
- ☆85Updated last month
- ☆29Updated 8 months ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆152Updated 6 months ago
- 从零实现一个小参数量中文大语言模型。☆593Updated 7 months ago
- AM (Advanced Mathematics) Chat is a large language model that integrates advanced mathematical knowledge, exercises in higher mathematics…☆183Updated 8 months ago
- 顾名思义:手搓的RAG☆120Updated last year
- Retriever-0.1B☆87Updated 10 months ago