tatsu-lab / alpaca_farm
A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.
☆806Updated 9 months ago
Alternatives and similar repositories for alpaca_farm:
Users that are interested in alpaca_farm are comparing it to the libraries listed below
- Multi-agent Social Simulation + Efficient, Effective, and Stable alternative of RLHF. Code for the paper "Training Socially Aligned Langu…☆347Updated last year
- [NIPS2023] RRHF & Wombat☆806Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆482Updated 10 months ago
- This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.☆545Updated last year
- RewardBench: the first evaluation tool for reward models.☆555Updated last month
- [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition☆628Updated 9 months ago
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆766Updated last year
- Official repository for LongChat and LongEval☆519Updated 11 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆336Updated last year
- [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…☆935Updated 6 months ago
- Human preference data for "Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback"☆1,723Updated last year
- Simple next-token-prediction for RLHF☆225Updated last year
- OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.☆555Updated last year
- ☆274Updated 3 months ago
- A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).☆833Updated last week
- ☆749Updated 10 months ago
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆679Updated 6 months ago
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,101Updated last year
- ☆459Updated last year
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆354Updated last year
- ☆356Updated 2 years ago
- LOMO: LOw-Memory Optimization☆985Updated 9 months ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆517Updated 2 months ago
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆284Updated 2 months ago
- Code for fine-tuning Platypus fam LLMs using LoRA☆629Updated last year
- Aligning Large Language Models with Human: A Survey☆727Updated last year
- Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03…☆534Updated last year
- Expanding natural instructions☆995Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆218Updated last year
- [NeurIPS 2022] 🛒WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents☆333Updated 7 months ago