Alternatives and similar repositories for RRHF:

Users that are interested in RRHF are comparing it to the libraries listed below

• XueFuzhao / InstructionWild
  ☆459Updated 10 months ago
• tatsu-lab / alpaca_farm
  A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
  ☆806Updated 9 months ago
• OpenLMLab / LOMO
  LOMO: LOw-Memory Optimization
  ☆985Updated 9 months ago
• AetherCortex / Llama-X
  Open Academic Research on Improving LLaMA to SOTA LLM
  ☆1,618Updated last year
• WeOpenML / PandaLM
  ☆913Updated 11 months ago
• OpenMOSS / CoLLiE
  Collaborative Training of Large Language Models in an Efficient Way
  ☆415Updated 7 months ago
• neelsjain / NEFTune
  Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning
  ☆395Updated 11 months ago
• SinclairCoder / Instruction-Tuning-Papers
  Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).
  ☆766Updated last year
• OpenLMLab / MOSS-RLHF
  Secrets of RLHF in Large Language Models Part I: PPO
  ☆1,357Updated last year
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆628Updated 9 months ago
• agi-templar / Stable-Alignment
  Multi-agent Social Simulation + Efficient, Effective, and Stable alternative of RLHF. Code for the paper "Training Socially Aligned Langu…
  ☆347Updated last year
• AGI-Edgerunners / LLM-Adapters
  Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"
  ☆1,154Updated last year
• jackaduma / Vicuna-LoRA-RLHF-PyTorch
  A full pipeline to finetune Vicuna LLM with LoRA and RLHF on consumer hardware. Implementation of RLHF (Reinforcement Learning with Human…
  ☆213Updated 11 months ago
• Shark-NLP / OpenICL
  OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.
  ☆555Updated last year
• itsnamgyu / reasoning-teacher
  Large Language Models Are Reasoning Teachers (ACL 2023)
  ☆332Updated last month
• DachengLi1 / LongChat
  Official repository for LongChat and LongEval
  ☆519Updated 11 months ago
• hkust-nlp / deita
  Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]
  ☆547Updated 4 months ago
• ruixiangcui / AGIEval
  ☆749Updated 10 months ago
• HuangLK / transpeeder
  train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism
  ☆218Updated last year
• raunak-agarwal / instruction-datasets
  All available datasets for Instruction Tuning of Large Language Models
  ☆248Updated last year
• bojone / NBCE
  Naive Bayes-based Context Extension
  ☆326Updated 4 months ago
• thunlp / ToolLearningPapers
  ☆900Updated 9 months ago
• sangmichaelxie / doremi
  Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
  ☆321Updated last year
• declare-lab / instruct-eval
  This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.
  ☆545Updated last year
• GaryYufei / AlignLLMHumanSurvey
  Aligning Large Language Models with Human: A Survey
  ☆727Updated last year
• princeton-nlp / LESS
  [ICML 2024] LESS: Selecting Influential Data for Targeted Instruction Tuning
  ☆435Updated 6 months ago
• princeton-nlp / LLM-Shearing
  [ICLR 2024] Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
  ☆598Updated last year
• OFA-Sys / ExpertLLaMA
  An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.
  ☆300Updated last year
• bojone / rerope
  Rectified Rotary Position Embeddings
  ☆366Updated 11 months ago
• FreedomIntelligence / InstructionZoo
  ☆278Updated last year