Alternatives and similar repositories for BMTrain:

Users that are interested in BMTrain are comparing it to the libraries listed below

• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆246Updated last year
• OpenBMB / BMCook
  Model Compression for Big Models
  ☆157Updated last year
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆644Updated last year
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆578Updated 2 years ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆411Updated 5 months ago
• XueFuzhao / InstructionWild
  ☆456Updated 8 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆799Updated last year
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 2024)
  ☆780Updated last month
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆215Updated last year
• LLaMafia / llamafia.github
  ☆318Updated 7 months ago
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,013Updated 5 months ago
• alibaba / Pai-Megatron-Patch
  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
  ☆851Updated last week
• yangjianxin1 / LLMPruner
  ☆304Updated last year
• FreedomIntelligence / InstructionZoo
  ☆278Updated 9 months ago
• OpenBMB / CPM-Live
  Live Training for Open-source Big Models
  ☆508Updated last year
• sunzeyeah / RLHF
  Implementation of Chinese ChatGPT
  ☆287Updated last year
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆303Updated last week
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆320Updated 2 months ago
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆471Updated 2 months ago
• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆359Updated 6 months ago
• ruixiangcui / AGIEval
  ☆728Updated 8 months ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆922Updated 2 months ago
• mindspore-lab / mindformers
  ☆152Updated this week
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆592Updated 3 weeks ago
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆319Updated 7 months ago
• WeOpenML / PandaLM
  ☆903Updated 8 months ago
• OpenBMB / BMList
  A List of Big Models
  ☆341Updated last year
• hkust-nlp / deita
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆534Updated 2 months ago
• bigscience-workshop / data-preparation
  Code used for sourcing and cleaning the BigScience ROOTS corpus
  ☆307Updated last year
• OpenLMLab / LEval
  [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark
  ☆369Updated 7 months ago