yangzhipeng1108 / moss-finetune-and-moss-finetune-int8Links
实现moss int8的finetune和优化源moss项目模型保 存问题
☆17Updated 2 years ago
Alternatives and similar repositories for moss-finetune-and-moss-finetune-int8
Users that are interested in moss-finetune-and-moss-finetune-int8 are comparing it to the libraries listed below
Sorting:
- ☆162Updated 2 years ago
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆195Updated 2 years ago
- 大语言模型指令调优工具(支持 FlashAttention)☆175Updated last year
- ☆307Updated 2 years ago
- Implementation of Chinese ChatGPT☆285Updated last year
- ☆280Updated last year
- pCLUE: 1000000+多任务提示学习数据集☆499Updated 2 years ago
- 实现了Baichuan-Chat微调,Lora、QLora等各种微调方式,一键运行。☆71Updated last year
- MEASURING MASSIVE MULTITASK CHINESE UNDERSTANDING☆88Updated last year
- deepspeed+trainer简单高效实现多卡微调大模型☆126Updated 2 years ago
- A Chinese Open-Domain Dialogue System☆321Updated last year
- 使用peft库,对chatGLM-6B/chatGLM2-6B实现4bit的QLoRA高效微调,并做lora model和base model的merge及4bit的量化(quantize)。☆360Updated last year
- 语言模型中文认知能力分析☆236Updated last year
- ☆64Updated 2 years ago
- Baichuan-13B 指令微调☆90Updated 2 years ago
- chatglm多gpu用deepspeed和☆407Updated last year
- Efficient, Low-Resource, Distributed transformer implementation based on BMTrain☆258Updated last year
- text embedding☆146Updated last year
- GoGPT:基于Llama/Llama 2训练的中英文增强大模型|Chinese-Llama2☆78Updated last year
- A Massive Multi-Level Multi-Subject Knowledge Evaluation benchmark☆102Updated 2 years ago
- ChatGLM2-6B 全参数微调,支持多轮对话的高效微调。☆399Updated last year
- Naive Bayes-based Context Extension☆326Updated 7 months ago
- deep learning☆148Updated 2 months ago
- Python ROUGE Score Implementation for Chinese Language Task (official rouge score)☆104Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆114Updated 2 years ago
- A framework for cleaning Chinese dialog data☆272Updated 4 years ago
- 使用qlora对中文大语言模型进行微调,包含ChatGLM、Chinese-LLaMA-Alpaca、BELLE☆87Updated 2 years ago
- T2Ranking: A large-scale Chinese benchmark for passage ranking.☆159Updated 2 years ago
- [SIGIR 2022] Multi-CPR: A Multi Domain Chinese Dataset for Passage Retrieval☆188Updated 2 years ago
- alpaca中文指令微调数据集☆392Updated 2 years ago