Alternatives and similar repositories for Keep-Learning

Users that are interested in Keep-Learning are comparing it to the libraries listed below

• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆177Updated 2 years ago
• cauyxy / bilivideos
  ☆53Updated 2 years ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆102Updated last year
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆408Updated last month
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆120Updated last year
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆359Updated 8 months ago
• hengjiUSTC / learn-llm
  ☆114Updated 10 months ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆416Updated last year
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆190Updated 3 years ago
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆340Updated last year
• sunkx109 / llama
  Inference code for LLaMA models
  ☆123Updated 2 years ago
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆158Updated 11 months ago
• WangHuiNEU / llm
  The Roadmap for LLMs
  ☆86Updated 2 years ago
• Outsider565 / LoRA-GA
  ☆209Updated 11 months ago
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆284Updated 2 years ago
• mindspore-lab / mindrlhf
  ☆36Updated 9 months ago
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆92Updated 2 years ago
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆65Updated 7 months ago
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆70Updated 2 years ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆98Updated last year
• genggui001 / Megatron-DeepSpeed-Llama
  ☆84Updated 2 years ago
• chunhuizhang / pytorch_distribute_tutorials
  pytorch distribute tutorials
  ☆152Updated 3 months ago
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆482Updated 9 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆661Updated last year
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆152Updated 2 years ago
• OpenLLMAI / OpenLLMWiki
  OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXi…
  ☆262Updated 9 months ago
• qingkelab / qingketalk
  青稞Talk
  ☆146Updated this week
• tingshua-yts / BetterDL
  ☆37Updated 2 years ago
• lansinuote / Simple_LLM_PPO
  ☆45Updated last year
• RUC-GSAI / Yulan-GARDEN
  Official Repository for SIGIR2024 Demo Paper "An Integrated Data Processing Framework for Pretraining Foundation Models"
  ☆82Updated last year