owenliang / pytorch-transformer
pytorch复现transformer
☆76Updated last year
Alternatives and similar repositories for pytorch-transformer:
Users that are interested in pytorch-transformer are comparing it to the libraries listed below
- pytorch复现stable diffusion☆164Updated last year
- vision transformer on mnist dataset☆30Updated last year
- LLM大模型(重点)以及搜广推等 AI 算法中手写的面试题,(非 LeetCode),比如 Self-Attention, AUC等,一般比 LeetCode 更考察一个人的综合能力,又更贴近业务和基础知识一点☆232Updated 3 months ago
- Diffusion Transformers (DiTs) trained on MNIST dataset☆98Updated last year
- 包含程序员面试大厂面试题和面试经验☆124Updated 3 months ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆177Updated 11 months ago
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆350Updated last month
- 通义千问的DPO训练☆45Updated 6 months ago
- ☆65Updated 8 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆120Updated 5 months ago
- pytorch distribute tutorials☆119Updated last month
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆158Updated last year
- LLM Tokenizer with BPE algorithm☆31Updated 11 months ago
- ☆150Updated last year
- Huggingface transformers的中文文档☆229Updated last year
- 从0开始,将chatgpt的技术路线跑一遍。☆228Updated 7 months ago
- DeepSpeed Tutorial☆95Updated 8 months ago
- ☆25Updated this week
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆152Updated 6 months ago
- ☆308Updated 2 months ago
- 一个很小很小的RAG系统☆195Updated 4 months ago
- Qwen2.5 0.5B GRPO☆37Updated 2 months ago
- TinyRAG☆285Updated 5 months ago
- 对llama3进行全参微调、lora微调以及qlora微调。☆192Updated 6 months ago
- 大语言模型应用:RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆60Updated 2 months ago
- personal chatgpt☆358Updated 4 months ago
- 关于Transformer模型的最简洁pytorch实现,包含详细注释☆189Updated last year
- 模型压缩的小白入门教程☆265Updated 4 months ago
- 从0到1构建一个MiniLLM (pretrain+sft+dpo实践中)☆415Updated 3 weeks ago
- 大模型基础学习和面试八股文☆106Updated last year