sxontheway / Keep-Learning
The record of what I‘ve been through.
☆95Updated last month
Alternatives and similar repositories for Keep-Learning:
Users that are interested in Keep-Learning are comparing it to the libraries listed below
- ☆52Updated last year
- ☆78Updated last year
- DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）☆151Updated last year
- Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.☆94Updated last year
- A light-weight script for maintaining a LOT of machine learning experiments.☆91Updated 2 years ago
- Python Scritpt which can be embedded into PyTorch model to print the model size.☆18Updated 3 years ago
- A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…☆277Updated last year
- pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用☆92Updated 11 months ago
- ChatGPT相关资源汇总☆55Updated last year
- ATC23 AE☆45Updated last year
- The pure and clear PyTorch Distributed Training Framework.☆276Updated last year
- An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star☆176Updated 2 years ago
- A MoE impl for PyTorch, [ATC'23] SmartMoE☆61Updated last year
- A brief of TorchScript by MNIST☆108Updated 2 years ago
- LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training☆398Updated last month
- 使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。☆116Updated last year
- ☆84Updated last year
- The Roadmap for LLMs☆84Updated last year
- PyTorch Dataset Rank Dataset☆42Updated 3 years ago
- ☆104Updated 4 months ago
- 基于Gated Attention Unit的Transformer模型（尝鲜版）☆97Updated 2 years ago
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆248Updated last year
- WuDaoMM this is a data project☆71Updated 2 years ago
- NTK scaled version of ALiBi position encoding in Transformer.☆66Updated last year
- Simple tutorials on Pytorch DDP training☆275Updated 2 years ago
- an implementation of transformer, bert, gpt, and diffusion models for learning purposes☆150Updated 4 months ago
- Must-read Papers of Parameter-Efficient Tuning (Delta Tuning) Methods on Pre-trained Models.☆281Updated last year
- 中文 Instruction tuning datasets☆128Updated 11 months ago
- 包含程序员面试大厂面试题和面试经验☆122Updated 2 months ago
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆301Updated 7 months ago