chunhuizhang / pytorch_distribute_tutorials
pytorch distribute tutorials
☆85Updated last month
Related projects ⓘ
Alternatives and complementary repositories for pytorch_distribute_tutorials
- ☆223Updated 8 months ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆147Updated last month
- personal chatgpt☆322Updated this week
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆269Updated 4 months ago
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆118Updated last year
- Inference code for LLaMA models☆109Updated last year
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆62Updated last week
- ☆53Updated last week
- 包含程序员面试大厂面试题和面试经验☆106Updated 3 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆347Updated this week
- A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks☆252Updated 3 months ago
- 一些 LLM 方面的从零复现笔记☆139Updated 2 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆89Updated 6 months ago
- 欢迎来到 LLM-Dojo,这里是一个开源大模型学习场所,使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩🎓👨🎓☆350Updated 2 weeks ago
- 大模型基础学习和面试八股文☆70Updated 7 months ago
- 使用单个24G显卡,从0开始训练LLM☆49Updated last month
- 从零实现一个小参数量中文大语言模型。☆280Updated 3 months ago
- 该仓库主要记录 LLMs 算法工程师相关的顶会论文研读笔记(多模态、PEFT、小样本QA问答、RAG、LMMs可解释性、Agents、CoT)☆265Updated 7 months ago
- TinyRAG☆237Updated 3 weeks ago
- The related works and background techniques about Openai o1☆144Updated 2 weeks ago
- llama2 finetuning with deepspeed and lora☆167Updated last year
- Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models☆53Updated 5 months ago
- awesome papers in LLM interpretability☆329Updated this week
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆331Updated 2 months ago
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆262Updated this week
- A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…☆274Updated last year
- 对llama3进行全参微调、lora微调以及qlora微调。☆152Updated last month
- Cool Papers - Immersive Paper Discovery☆407Updated this week
- ☆85Updated last week
- DeepSpeed Tutorial☆90Updated 3 months ago