Alternatives and similar repositories for BMTrain:

Users that are interested in BMTrain are comparing it to the libraries listed below

• OpenBMB / BMCook
  Model Compression for Big Models
  ☆161Updated last year
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆253Updated last year
• OpenBMB / BMInf
  Efficient Inference for Big Models
  ☆583Updated 2 years ago
• alibaba / Megatron-LLaMA
  Best practice for training LLaMA models in Megatron-LM
  ☆650Updated last year
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 8 months ago
• XueFuzhao / InstructionWild
  ☆459Updated 10 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆219Updated last year
• thunlp / OpenDelta
  A plug-and-play library for parameter-efficient-tuning (Delta Tuning)
  ☆1,026Updated 7 months ago
• jianzhnie / LLamaTuner
  Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.
  ☆602Updated 3 months ago
• flageval-baai / FlagEval
  FlagEval is an evaluation toolkit for AI large foundation models.
  ☆335Updated last week
• alibaba / ChatLearn
  A flexible and efficient training framework for large-scale alignment tasks
  ☆343Updated 2 months ago
• LLaMafia / llamafia.github
  ☆318Updated 9 months ago
• mindspore-lab / mindformers
  ☆161Updated 3 weeks ago
• OpenBMB / UltraEval
  [ACL 2024 Demo] Official GitHub repo for UltraEval: An open source framework for evaluating foundation models.
  ☆240Updated 6 months ago
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆326Updated 4 months ago
• pjlab-sys4nlp / llama-moe
  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)
  ☆959Updated 5 months ago
• OpenBMB / CPM-Live
  Live Training for Open-source Big Models
  ☆506Updated last year
• alibaba / Pai-Megatron-Patch
  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
  ☆1,033Updated this week
• THUDM / LongBench
  LongBench v2 and LongBench (ACL 2024)
  ☆861Updated 3 months ago
• GanjinZero / RRHF
  [NIPS2023] RRHF & Wombat
  ☆806Updated last year
• sunzeyeah / RLHF
  Implementation of Chinese ChatGPT
  ☆287Updated last year
• OpenBMB / BMPrinciples
  A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…
  ☆279Updated last year
• yangjianxin1 / LLMPruner
  ☆308Updated 2 years ago
• OpenBMB / BMList
  A List of Big Models
  ☆343Updated last year
• FreedomIntelligence / InstructionZoo
  ☆279Updated last year
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,386Updated last year
• bojone / bytepiece
  更纯粹、更高压缩率的Tokenizer
  ☆480Updated 5 months ago
• carbonz0 / alpaca-chinese-dataset
  alpaca中文指令微调数据集
  ☆393Updated 2 years ago
• InternLM / InternEvo
  InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…
  ☆385Updated last week
• chaoswork / sft_datasets
  开源SFT数据集整理,随时补充
  ☆509Updated last year