Alternatives and similar repositories for BMTrain:

Users that are interested in BMTrain are comparing it to the libraries listed below

• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆244Updated last year
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆152Updated last year
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆574Updated last year
• XueFuzhao / InstructionWild
  ☆456Updated 7 months ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆638Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 4 months ago
• LLaMafia / llamafia.github
  ☆317Updated 6 months ago
• alibaba / Pai-Megatron-Patch
  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
  ☆798Updated this week
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆212Updated last year
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆802Updated last year
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 2024)
  ☆755Updated this week
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆908Updated last month
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆397Updated 2 months ago
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆585Updated this week
• FlagAI-Open / Aquila2
  The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.
  ☆440Updated 3 months ago
• Strivin0311 / long-llms-learning
  A repository sharing the literatures about long-context large language models, including the methodologies and the evaluation benchmarks
  ☆255Updated 5 months ago
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆276Updated last year
• OpenBMB / CPM-Live
  Live Training for Open-source Big Models
  ☆511Updated last year
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,009Updated 3 months ago
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆320Updated last month
• sunzeyeah / RLHF
  Implementation of Chinese ChatGPT
  ☆288Updated last year
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆315Updated 6 months ago
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆109Updated last year
• Tencent / TencentPretrain
  Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo
  ☆1,054Updated 5 months ago
• WeOpenML / PandaLM
  ☆894Updated 7 months ago
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆326Updated this week
• FreedomIntelligence / InstructionZoo
  ☆276Updated 8 months ago
• FlagOpen / FlagScale
  FlagScale is a large model toolkit based on open-sourced projects.
  ☆207Updated this week
• yangjianxin1 / LLMPruner
  ☆302Updated last year
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆400Updated 2 weeks ago