haoliuhl / chain-of-hindsight
Simple next-token-prediction for RLHF
☆222Updated last year
Alternatives and similar repositories for chain-of-hindsight:
Users that are interested in chain-of-hindsight are comparing it to the libraries listed below
- Self-Alignment with Principle-Following Reward Models☆154Updated 11 months ago
- ☆160Updated last year
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆277Updated last week
- DSIR large-scale data selection framework for language model training☆241Updated 10 months ago
- ☆96Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆229Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆242Updated last year
- A repository for transformer critique learning and generation☆88Updated last year
- ☆228Updated 2 years ago
- Code for Arxiv 2023: Improving Language Model Negociation with Self-Play and In-Context Learning from AI Feedback☆204Updated last year
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆157Updated 9 months ago
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- Scaling Data-Constrained Language Models☆333Updated 5 months ago
- ☆177Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- RewardBench: the first evaluation tool for reward models.☆505Updated this week
- ☆116Updated 3 months ago
- contrastive decoding☆192Updated 2 years ago
- Code and model release for the paper "Task-aware Retrieval with Instructions" by Asai et al.☆162Updated last year
- Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets☆311Updated last year
- ☆267Updated last month
- ☆172Updated last year
- Tk-Instruct is a Transformer model that is tuned to solve many NLP tasks by following instructions.☆179Updated 2 years ago
- Inspecting and Editing Knowledge Representations in Language Models☆112Updated last year
- [ACL'24 Outstanding] Data and code for L-Eval, a comprehensive long context language models evaluation benchmark☆369Updated 7 months ago
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆218Updated last year
- About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…☆70Updated last year
- RLHF implementation details of OAI's 2019 codebase☆178Updated last year
- Mass-editing thousands of facts into a transformer memory (ICLR 2023)☆462Updated last year
- ☆130Updated last year