Alternatives and similar repositories for Keep-Learning

Users that are interested in Keep-Learning are comparing it to the libraries listed below

• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆99Updated last year
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆162Updated last year
• cauyxy / bilivideos
  ☆52Updated last year
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆91Updated 2 years ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆154Updated 7 months ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆95Updated last year
• Outsider565 / LoRA-GA
  ☆194Updated 6 months ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆120Updated last year
• Ascend / AscendSpeed
  ☆79Updated last year
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆280Updated last year
• taishan1994 / sentencepiece_chinese_bpe
  使用sentencepiece中BPE训练中文词表，并在transformers中进行使用。
  ☆117Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆144Updated last year
• BIGBALLON / distribuuuu
  The pure and clear PyTorch Distributed Training Framework.
  ☆276Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆62Updated last year
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆111Updated 2 years ago
• ifromeast / LLMTrainer
  A comparison of pretraining framework for LLM
  ☆21Updated 3 months ago
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆403Updated last week
• WangHuiNEU / llm
  The Roadmap for LLMs
  ☆84Updated last year
• txsun1997 / awesome-early-exiting
  A curated list of Early Exiting papers, benchmarks, and misc.
  ☆115Updated last year
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆97Updated 9 months ago
• Oldpan / DeployIsAllYouNeed
  ☆120Updated last year
• thu-pacman / SmartMoE-AE
  ATC23 AE
  ☆45Updated 2 years ago
• hengjiUSTC / learn-llm
  ☆108Updated 6 months ago
• RUC-GSAI / Yulan-GARDEN
  Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"
  ☆80Updated 8 months ago
• rentainhe / pytorch-distributed-training
  Simple tutorials on Pytorch DDP training
  ☆279Updated 2 years ago
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆182Updated 2 years ago
• ModelTC / rank_dataset
  PyTorch Dataset Rank Dataset
  ☆42Updated 4 years ago
• xv44586 / Chinese-instruction-datasets
  中文 Instruction tuning datasets
  ☆131Updated last year
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆115Updated last year
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated last year