Alternatives and similar repositories for LLM-RLHF-Tuning

Users that are interested in LLM-RLHF-Tuning are comparing it to the libraries listed below

• wjn1996 / HugNLP
  HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊 HugNLP will released to…
  ☆243Updated 2 years ago
• HugAILab / HugNLP
  CIKM2023 Best Demo Paper Award. HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NL…
  ☆390Updated last year
• zwhe99 / MAPS-mt
  [TACL 2024] MAPS enables LLMs🤖 to mimic the human😁 translation process.
  ☆144Updated last year
• TylunasLi / ChatGLM-web-stream-demo
  ChatGLM-6B HTTP流式解码API的Flask、FastAPI实现，以及开箱即用的Web页面。 a stream decoding demo of ChatGLM-6B using Flask or FastAPI, with web page out-of-th…
  ☆93Updated last year
• ictnlp / TruthX
  Code for ACL 2024 paper "TruthX: Alleviating Hallucinations by Editing Large Language Models in Truthful Space"
  ☆144Updated last year
• OceannTwT / ra-isf
  [ACL 2024] RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback.
  ☆185Updated last year
• Tongjilibo / bert4torch
  An elegent pytorch implement of transformers
  ☆1,321Updated 2 weeks ago
• git-cloner / llama2-lora-fine-tuning
  llama2 finetuning with deepspeed and lora
  ☆176Updated 2 years ago
• l294265421 / alpaca-rlhf
  Finetuning LLaMA with RLHF (Reinforcement Learning with Human Feedback) based on DeepSpeed Chat
  ☆115Updated 2 years ago
• stanleylsx / llms_tool
  一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。
  ☆220Updated last year
• chunhuizhang / personal_chatgpt
  personal chatgpt
  ☆385Updated 9 months ago
• suu990901 / LLaMA-MiLe-Loss
  Code for a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models
  ☆65Updated 7 months ago
• yongzhuo / Qwen-SFT
  阿里通义千问(Qwen-7B-Chat/Qwen-7B), 微调/LORA/推理
  ☆120Updated last year
• Pillars-Creation / ChatGLM-RLHF-LoRA-RM-PPO
  ChatGLM-6B添加了RLHF的实现，以及部分核心代码的逐行讲解 ,实例部分是做了个新闻短标题的生成，以及指定context推荐的RLHF的实现
  ☆88Updated 2 years ago
• chaoswork / sft_datasets
  开源SFT数据集整理,随时补充
  ☆545Updated 2 years ago
• THUDM / AlignBench
  大模型多维度中文对齐评测基准 (ACL 2024)
  ☆413Updated last year
• jiangxinyang227 / LLM-tuning
  llama，chatglm 等模型的微调
  ☆91Updated last year
• 3DAgentWorld / Toolkit-for-Prompt-Compression
  Toolkit for Prompt Compression
  ☆274Updated 8 months ago
• yanqiangmiffy / how-to-train-tokenizer
  怎么训练一个LLM分词器
  ☆153Updated 2 years ago
• taishan1994 / Llama3.1-Finetuning
  对llama3进行全参微调、lora微调以及qlora微调。
  ☆210Updated last year
• jiahe7ay / MINI_LLM
  This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
  ☆473Updated 5 months ago
• chuanyangjin / MMToM-QA
  [🏆Outstanding Paper Award at ACL 2024] MMToM-QA: Multimodal Theory of Mind Question Answering
  ☆148Updated 7 months ago
• akaihaoshuai / baby-llama2-chinese_cybertron
  使用单个24G显卡，从0开始训练LLM
  ☆56Updated 3 months ago
• lansinuote / Simple_LLM_DPO
  ☆74Updated last year
• LWL-cpu / DEEIA
  [ACL 2024 Findings] The code for Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extraction
  ☆19Updated 11 months ago
• Miraclemarvel55 / ChatGLM-RLHF
  对ChatGLM直接使用RLHF提升或降低目标输出概率|Modify ChatGLM output with only RLHF
  ☆195Updated 2 years ago
• tianyi-lab / Cherry_LLM
  [NAACL'24] Self-data filtering of LLM instruction-tuning data using a novel perplexity-based difficulty score, without using any other mo…
  ☆396Updated 3 months ago
• jasonvanf / llama-trl
  LLaMA-TRL: Fine-tuning LLaMA with PPO and LoRA
  ☆229Updated last month
• OpenBMB / ModelCenter
  Efficient, Low-Resource, Distributed transformer implementation based on BMTrain
  ☆262Updated last year
• KbsdJames / Awesome-LLM-Preference-Learning
  The official repository of our survey paper: "Towards a Unified View of Preference Learning for Large Language Models: A Survey"
  ☆184Updated 11 months ago