haoliuhl / chain-of-hindsight
Simple next-token-prediction for RLHF
☆222Updated last year
Alternatives and similar repositories for chain-of-hindsight:
Users that are interested in chain-of-hindsight are comparing it to the libraries listed below
- ☆159Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆156Updated last year
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆281Updated last month
- ☆271Updated 2 months ago
- A repository for transformer critique learning and generation☆89Updated last year
- DSIR large-scale data selection framework for language model training☆244Updated 11 months ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆218Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆247Updated last year
- ☆235Updated 2 years ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- ☆178Updated 2 years ago
- Scaling Data-Constrained Language Models☆333Updated 6 months ago
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆157Updated 10 months ago
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- ☆96Updated last year
- RewardBench: the first evaluation tool for reward models.☆526Updated 3 weeks ago
- RLHF implementation details of OAI's 2019 codebase☆183Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆236Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆514Updated last month
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆118Updated 9 months ago
- ☆136Updated 4 months ago
- Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback☆205Updated last year
- Data and code for the ICLR 2023 paper "Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoning".☆149Updated last year
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆53Updated 5 months ago
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆374Updated 8 months ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆333Updated last year
- A curated list of Human Preference Datasets for LLM fine-tuning, RLHF, and eval.☆349Updated last year
- Accepted by Transactions on Machine Learning Research (TMLR)☆126Updated 5 months ago
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆316Updated last year
- Generative Judge for Evaluating Alignment☆230Updated last year