Joyce94 / LLM-RLHF-TuningLinks
LLM Tuning with PEFT (SFT+RM+PPO+DPO with LoRA)
☆440Updated 2 years ago
Alternatives and similar repositories for LLM-RLHF-Tuning
Users that are interested in LLM-RLHF-Tuning are comparing it to the libraries listed below
Sorting:
- HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊 HugNLP will released to…☆242Updated 2 years ago
- [TACL 2024] MAPS enables LLMs🤖 to mimic the human😁 translation process.☆144Updated last year
- CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NL…☆392Updated 2 years ago
- ChatGLM-6B HTTP流式解码API的Flask、FastAPI实现，以及开箱即用的Web页面。 a stream decoding demo of ChatGLM-6B using Flask or FastAPI, with web page out-of-th…☆93Updated last year
- [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.☆185Updated last year
- Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"☆143Updated last year
- ☆626Updated last year
- llama2 finetuning with deepspeed and lora☆175Updated 2 years ago
- ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现☆88Updated 2 years ago
- Toolkit for Prompt Compression☆282Updated 9 months ago
- An elegent pytorch implement of transformers☆1,330Updated 2 weeks ago
- Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat☆115Updated 2 years ago
- ☆548Updated 10 months ago
- 一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。☆220Updated last year
- [🏆Outstanding Paper Award at ACL 2024] MMToM-QA: Multimodal Theory of Mind Question Answering☆152Updated 8 months ago
- Prompt Learning using Metaheuristics☆135Updated last year
- Implementation of Chinese ChatGPT☆289Updated 2 years ago
- LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA☆233Updated 3 months ago
- 开源SFT数据集整理,随时补充☆557Updated 2 years ago
- 怎么训练一个LLM分词器☆154Updated 2 years ago
- 使用单个24G显卡，从0开始训练LLM☆55Updated 4 months ago
- [ACL 2024 Findings] The code for Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extraction☆19Updated last year
- The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"☆185Updated last year
- [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…☆400Updated 4 months ago
- ☆146Updated last year
- llama，chatglm 等模型的微调☆91Updated last year
- The related works and background techniques about Openai o1☆221Updated 10 months ago
- A full pipeline to finetune ChatGLM LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Huma…☆140Updated 2 years ago
- OpenLLMWiki: Docs of OpenLLMAI. Survey, reproduction and domain/task adaptation of open source chatgpt alternatives/implementations. PiXi…☆262Updated 11 months ago
- Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date…☆1,650Updated this week