OpenBMB / ModelCenter
Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
☆243Updated last year
Alternatives and similar repositories for ModelCenter:
Users that are interested in ModelCenter are comparing it to the libraries listed below
- Model Compression for Big Models☆155Updated last year
- Efficient Training (including pre-training and fine-tuning) for Big Models☆573Updated 6 months ago
- ☆277Updated 9 months ago
- Implementation of Chinese ChatGPT☆287Updated last year
- ☆456Updated 7 months ago
- Collaborative Training of Large Language Models in an Efficient Way☆410Updated 5 months ago
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆333Updated 4 months ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆109Updated last year
- A collection of phenomenons observed during the scaling of big foundation models, which may be developed into consensus, principles, or l…☆276Updated last year
- Efficient Inference for Big Models☆577Updated 2 years ago
- ☆302Updated last year
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆213Updated last year
- 怎么训练一个LLM分词器☆138Updated last year
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆192Updated last year
- OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXi…☆255Updated last month
- 中文 Instruction tuning datasets☆124Updated 9 months ago
- ☆84Updated last year
- ☆125Updated last year
- 语言模型中文认知能力分析☆236Updated last year
- pCLUE: 1000000+多任务提示学习数据集☆476Updated 2 years ago
- A Massive Multi-Level Multi-Subject Knowledge Evaluation benchmark☆100Updated last year
- 开源SFT数据集整理,随时补充☆475Updated last year
- FlagEval is an evaluation toolkit for AI large foundation models.☆316Updated 6 months ago
- Code for "Lion: Adversarial Distillation of Proprietary Large Language Models (EMNLP 2023)"☆203Updated 11 months ago
- alpaca中文指令微调数据集☆392Updated last year
- Live Training for Open-source Big Models☆509Updated last year
- deep learning☆150Updated 7 months ago
- 大模型多维度中文对齐评测基准 (ACL 2024)☆355Updated 5 months ago
- ☆159Updated last year
- Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型☆403Updated last year