Joyce94 / LLM-RLHF-TuningLinks
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
☆420Updated last year
Alternatives and similar repositories for LLM-RLHF-Tuning
Users that are interested in LLM-RLHF-Tuning are comparing it to the libraries listed below
Sorting:
- HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊 HugNLP will released to…☆247Updated last year
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆147Updated last year
- ChatGLM-6B添加了RLHF的实现,以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成,以及指定context推荐的RLHF的实现☆85Updated last year
- [TACL 2024] MAPS enables LLMs🤖 to mimic the human😁 translation process.☆141Updated 11 months ago
- personal chatgpt☆372Updated 5 months ago
- 怎么训练一个LLM分词器☆149Updated last year
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆190Updated 8 months ago
- CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NL…☆388Updated last year
- 对llama3进行全参微调、lora微调以及qlora微调。☆198Updated 8 months ago
- 一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测,低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。☆217Updated last year
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆370Updated 8 months ago
- llama2 finetuning with deepspeed and lora☆174Updated last year
- 开源SFT数据集整理,随时补充☆516Updated 2 years ago
- 对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF☆194Updated 2 years ago
- Implementation of Chinese ChatGPT☆287Updated last year
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆115Updated 2 years ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆436Updated last month
- ☆69Updated last year
- ☆141Updated last year
- ☆108Updated 6 months ago
- ☆540Updated 5 months ago
- ChatGLM-6B HTTP流式解码API的Flask、FastAPI实现,以及开箱即用的Web页面。 a stream decoding demo of ChatGLM-6B using Flask or FastAPI, with web page out-of-th…☆92Updated last year
- ☆110Updated 11 months ago
- OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXi…☆261Updated 5 months ago
- llama,chatglm 等模型的微调☆89Updated 10 months ago
- Deepspeed、LLM、Medical_Dialogue、医疗大模型、预训练、微调☆267Updated 11 months ago
- 《ChatGPT原理与实战:大型语言模型的算法、技术和私有化》☆357Updated last year
- 使用单个24G显卡,从0开始训练LLM☆54Updated last week
- 阿里通义千问(Qwen-7B-Chat/Qwen-7B), 微调/LORA/推理☆104Updated last year
- The related works and background techniques about Openai o1☆221Updated 4 months ago