GanjinZero / RRHF
[NIPS2023] RRHF & Wombat
☆807Updated last year
Alternatives and similar repositories for RRHF
Users that are interested in RRHF are comparing it to the libraries listed below
Sorting:
- A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.☆810Updated 10 months ago
- ☆459Updated 11 months ago
- ☆750Updated 11 months ago
- LOMO: LOw-Memory Optimization☆986Updated 10 months ago
- ☆914Updated 11 months ago
- Multi-agent Social Simulation + Efficient, Effective, and Stable alternative of RLHF. Code for the paper "Training Socially Aligned Langu…☆347Updated last year
- Open Academic Research on Improving LLaMA to SOTA LLM☆1,621Updated last year
- Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"☆1,162Updated last year
- Deita: Data-Efficient Instruction Tuning for Alignment [ICLR2024]☆554Updated 5 months ago
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆633Updated 9 months ago
- train llama on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism☆219Updated last year
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆559Updated last year
- Large Language Models Are Reasoning Teachers (ACL 2023)☆335Updated 2 months ago
- Secrets of RLHF in Large Language Models Part I: PPO☆1,359Updated last year
- ☆901Updated 9 months ago
- Collaborative Training of Large Language Models in an Efficient Way☆415Updated 8 months ago
- Official repository for LongChat and LongEval☆519Updated 11 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆324Updated last year
- Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning☆395Updated 11 months ago
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆769Updated last year
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆546Updated last year
- Naive Bayes-based Context Extension☆326Updated 5 months ago
- ☆280Updated last year
- Codes and Data for Scaling Relationship on Learning Mathematical Reasoning with Large Language Models☆261Updated 8 months ago
- An opensource ChatBot built with ExpertPrompting which achieves 96% of ChatGPT's capability.☆300Updated last year
- A large-scale, fine-grained, diverse preference dataset (and models).☆338Updated last year
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆377Updated 10 months ago
- Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback☆1,462Updated 11 months ago
- [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward☆894Updated 3 months ago
- Papers and Datasets on Instruction Tuning and Following. ✨✨✨☆496Updated last year