BoXiaolei / MyTransformer_pytorchLinks
关于Transformer模型的最简洁pytorch实现,包含详细注释
☆211Updated last year
Alternatives and similar repositories for MyTransformer_pytorch
Users that are interested in MyTransformer_pytorch are comparing it to the libraries listed below
Sorting:
- Transformer是谷歌在17年发表的Attention Is All You Need 中使用的模型,经过这些年的大量的工业使用和论文验证,在深度学习领域已经占据重要地位。Bert就是从Transformer中衍生出来的语言模型。 我会以中文翻译英文为例,来解释Tran…☆279Updated last year
- 看图学大模型☆317Updated last year
- 深度学习系统笔记,包含深度学习数学基础知识、神经网络基础部件详解、深度学习炼丹策略、模型压缩算法详解。☆494Updated 3 months ago
- MindSpore online courses: Step into LLM☆478Updated 3 weeks ago
- Huggingface transformers的中文文档☆271Updated last year
- 和李沐一起读论文☆211Updated 2 months ago
- ☆284Updated 4 months ago
- 一些 LLM 方面的从零复现笔记☆219Updated 4 months ago
- modern AI for beginners☆158Updated 3 weeks ago
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆359Updated 8 months ago
- Transformer的完整实现。详细构建Encoder、Decoder、Self-attention。以实际例子进行展示,有完整的输入、训练、预测过程。可用于学习理解self-attention和Transformer☆97Updated 5 months ago
- Learning LLM Implementaion and Theory for Practical Landing☆185Updated 8 months ago
- 《跟我一起深度学习》@月来客栈 出品☆226Updated last month
- 模型压缩的小白入门教程,PDF下载地址 https://github.com/datawhalechina/awesome-compression/releases☆320Updated 2 months ago
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆471Updated 5 months ago
- 大模型/LLM推理和部署理论与实践☆323Updated last month
- ☆372Updated 7 months ago
- ☆191Updated 3 years ago
- 一个很小很小的RAG系统☆283Updated 4 months ago
- 从0开始,将chatgpt的技术路线跑一遍。☆255Updated last year
- ☆102Updated last year
- Train a 1B LLM with 1T tokens from scratch by personal☆727Updated 4 months ago
- 个人构建MoE大模型:从预训练到DPO的完整实践☆958Updated this week
- Learning Large Language Model (LLM)(大语言模型学习)☆795Updated 4 months ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆863Updated 2 weeks ago
- 人工智能培训课件资源☆110Updated this week
- pytorch distribute tutorials☆151Updated 2 months ago
- TinyRAG☆333Updated 2 months ago
- personal chatgpt☆384Updated 8 months ago
- 包含程序员面试大厂面试题和面试经验☆176Updated 3 months ago