BoXiaolei / MyTransformer_pytorch
关于Transformer模型的最简洁pytorch实现,包含详细注释
☆193Updated last year
Alternatives and similar repositories for MyTransformer_pytorch:
Users that are interested in MyTransformer_pytorch are comparing it to the libraries listed below
- 看图学大模型☆294Updated 9 months ago
- Transformer的完整实现。详细构建Encoder、Decoder、Self-attention。以实际例子进行展示,有完整的输入、训练、预测过程。可用于学习理解self-attention和Transformer☆78Updated 3 weeks ago
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆425Updated last month
- ☆315Updated 2 months ago
- Transformer是谷歌在17年发表的Attention Is All You Need 中使用的模型,经过这些年的大量的工业使用和论文验证,在深度学习领域已经占据重要地位。Bert就是从Transformer中衍生出来的语言模型。我会以中文翻译英文为例,来解释Tran…☆252Updated last year
- 一些 LLM 方面的从零复现笔记☆187Updated last week
- personal chatgpt☆362Updated 4 months ago
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆250Updated 4 months ago
- modern AI for beginners☆128Updated 3 weeks ago
- 模型压缩的小白入门教程☆273Updated 5 months ago
- Huggingface transformers的中文文档☆236Updated last year
- ☆71Updated 8 months ago
- 大模型/LLM推理和部署理论与实践☆250Updated last month
- 一个很小很小的RAG系统☆215Updated last week
- 从零实现一个小参数量中文大语言模型。☆618Updated 8 months ago
- Learning LLM Implementaion and Theory for Practical Landing☆151Updated 4 months ago
- 从0开始,将chatgpt的技术路线跑一遍。☆232Updated 8 months ago
- 大模型基础学习和面试八股文☆113Updated last year
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆185Updated 11 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆426Updated this week
- DeepSpeed Tutorial☆96Updated 8 months ago
- 深度学习系统笔记,包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解。☆467Updated this week
- Inference code for LLaMA models☆120Updated last year
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆707Updated 2 weeks ago
- ☆71Updated 7 months ago
- TinyRAG☆294Updated last week
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆120Updated 5 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆627Updated last week
- 图深度学习(葡萄书),在线阅读地址: https://datawhalechina.github.io/grape-book☆227Updated last year
- pytorch distribute tutorials☆126Updated last week