Tsai-chasel / training-methods-tutorial
☆11Updated last year
Alternatives and similar repositories for training-methods-tutorial:
Users that are interested in training-methods-tutorial are comparing it to the libraries listed below
- DeepSpeed Tutorial☆94Updated 5 months ago
- Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conv…☆395Updated last month
- DeepSpeed教程 & 示例注释 & 学习笔记 (大模型高效训练)☆146Updated last year
- huggingface mirror download☆557Updated 2 months ago
- A collection of diffusion models based on MindSpore☆160Updated last year
- pytorch单精度、半精度、混合精度、单卡、多卡(DP / DDP)、FSDP、DeepSpeed模型训练代码,并对比不同方法的训练速度以及GPU内存的使用☆87Updated 10 months ago
- 多模态 MM +Chat 合集☆238Updated 3 weeks ago
- 主要记录大语言大模型(LLMs) 算法(应用)工程师多模态相关知识☆118Updated 8 months ago
- ☆258Updated 10 months ago
- ☆151Updated last month
- [MIR-2023-Survey] A continuously updated paper list for multi-modal pre-trained big models☆284Updated 2 weeks ago
- 支持中英文双语视觉-文本对话的开源可商用多模态模型。☆361Updated last year
- FlagEval is an evaluation toolkit for AI large foundation models.☆316Updated 6 months ago
- 欢迎来到 "LLM-travel" 仓库!探索大语言模型(LLM)的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆287Updated 6 months ago
- chatglm多gpu用deepspeed和☆403Updated 6 months ago
- 更纯粹、更高压缩率的Tokenizer☆468Updated 2 months ago
- 一款便捷的抢占显卡脚本☆298Updated last week
- LLMs interview notes and answers:该仓库主要记录大模型(LLMs)算法工程师相关的面试题和参考答案☆423Updated last year
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆386Updated 9 months ago
- pytorch distribute tutorials☆101Updated 3 months ago
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆379Updated this week
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆809Updated last week
- Research Code for Multimodal-Cognition Team in Ant Group☆133Updated 6 months ago
- Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Pre-training Dataset and Benchmarks☆290Updated last year
- The pure and clear PyTorch Distributed Training Framework.☆275Updated last year
- 利用HuggingFace的官方下载工具从镜像网站进行高速下载。☆936Updated 3 months ago
- ☆158Updated last year
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆150Updated 3 months ago
- Train a 1B LLM with 1T tokens from scratch by personal☆487Updated this week
- TaiSu(太素)--a large-scale Chinese multimodal dataset(亿级大规模中文视觉语言预训练数据集)☆177Updated last year