xxcheng0708 / pytorch-model-train-templateLinks
pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
☆100Updated last year
Alternatives and similar repositories for pytorch-model-train-template
Users that are interested in pytorch-model-train-template are comparing it to the libraries listed below
Sorting:
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆164Updated last year
- DeepSpeed Tutorial☆97Updated 9 months ago
- 多模态 MM +Chat 合集☆266Updated 2 weeks ago
- ☆41Updated 4 months ago
- 主要记录大语言大模型（LLMs） 算法（应用）工程师多模态相关知识☆196Updated last year
- Reading notes about Multimodal Large Language Models, Large Language Models, and Diffusion Models☆436Updated 3 weeks ago
- Yet another PyTorch Trainer and some core components for deep learning.☆217Updated last year
- ☆198Updated 7 months ago
- Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources☆216Updated 2 weeks ago
- Efficient Multimodal Large Language Models: A Survey☆349Updated last month
- 一款便捷的抢占显卡脚本☆334Updated 4 months ago
- Keras implement of Finite Scalar Quantization☆73Updated last year
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆153Updated 7 months ago
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆448Updated 2 months ago
- A generalized framework for subspace tuning methods in parameter efficient fine-tuning.☆141Updated 3 months ago
- ☆329Updated 3 months ago
- LoRAMoE: Revolutionizing Mixture of Experts for Maintaining World Knowledge in Language Model Alignment☆339Updated last year
- pytorch distribute tutorials☆135Updated last week
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models☆294Updated 3 months ago
- My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"☆234Updated 2 months ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆209Updated 2 months ago
- WWW2025 Multimodal Intent Recognition for Dialogue Systems Challenge☆123Updated 6 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆443Updated 4 months ago
- ☆62Updated 3 years ago
- Cool Papers - Immersive Paper Discovery☆543Updated 3 weeks ago
- Rethinking RL Scaling for Vision Language Models: A Transparent, From-Scratch Framework and Comprehensive Evaluation Scheme☆127Updated last month
- Lion and Adam optimization comparison☆61Updated 2 years ago
- (Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from …☆166Updated last year
- [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…☆248Updated 4 months ago
- 和李沐一起读论文☆195Updated 3 weeks ago