Alternatives and similar repositories for Keep-Learning

Users that are interested in Keep-Learning are comparing it to the libraries listed below

• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆416Updated 10 months ago
• Ascend / AscendSpeed
  ☆79Updated last year
• cauyxy / bilivideos
  ☆52Updated 2 years ago
• bobo0810 / LearnDeepSpeed
  DeepSpeed教程 & 示例注释 & 学习笔记 （大模型高效训练）
  ☆169Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆64Updated 2 years ago
• CoinCheung / gdGPT
  Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
  ☆97Updated last year
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆408Updated 3 weeks ago
• OvJat / DeepSpeedTutorial
  DeepSpeed Tutorial
  ☆98Updated 11 months ago
• cnstark / gputasker
  An awesome gpu tasks scheduler. 轻量好用的GPU机群任务调度工具。觉得有用可以点个star
  ☆185Updated 2 years ago
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆281Updated last year
• Glanvery / LLM-Travel
  欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。
  ☆328Updated 11 months ago
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆97Updated 8 months ago
• luchangli03 / export_llama_to_onnx
  export llama to onnx
  ☆129Updated 6 months ago
• Outsider565 / LoRA-GA
  ☆202Updated 8 months ago
• louis-she / torchscript-demos
  A brief of TorchScript by MNIST
  ☆112Updated 3 years ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆657Updated last year
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆163Updated 2 years ago
• sunkx109 / llama
  Inference code for LLaMA models
  ☆122Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆374Updated last year
• genggui001 / Megatron-DeepSpeed-Llama
  ☆83Updated last year
• kyegomez / AttentionIsOFFByOne
  Implementation of "Attention Is Off By One" by Evan Miller
  ☆193Updated last year
• firechecking / CleanTransformer
  an implementation of transformer, bert, gpt, and diffusion models for learning purposes
  ☆155Updated 9 months ago
• xxcheng0708 / pytorch-model-train-template
  pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
  ☆112Updated last year
• godweiyang / GrabGPU
  一款便捷的抢占显卡脚本
  ☆339Updated 5 months ago
• Tlntin / ChatGLM2-6B-TensorRT
  ☆90Updated 2 years ago
• rentainhe / pytorch-distributed-training
  Simple tutorials on Pytorch DDP training
  ☆281Updated 2 years ago
• simtony / mlrunner
  A light-weight script for maintaining a LOT of machine learning experiments.
  ☆91Updated 2 years ago
• WangHuiNEU / llm
  The Roadmap for LLMs
  ☆85Updated last year
• QingruZhang / AdaLoRA
  AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning (ICLR 2023).
  ☆336Updated 2 years ago
• lvyufeng / cybertron-ai
  mindspore implementation of transformers
  ☆68Updated 2 years ago