haoliuhl / chain-of-hindsight
Simple next-token-prediction for RLHF
☆225Updated last year
Alternatives and similar repositories for chain-of-hindsight:
Users that are interested in chain-of-hindsight are comparing it to the libraries listed below
- ☆159Updated 2 years ago
- ☆97Updated last year
- A repository for transformer critique learning and generation☆90Updated last year
- Code accompanying the paper Pretraining Language Models with Human Preferences☆180Updated last year
- ☆237Updated 2 years ago
- Self-Alignment with Principle-Following Reward Models☆160Updated last year
- All available datasets for Instruction Tuning of Large Language Models☆250Updated last year
- ☆275Updated 3 months ago
- DSIR large-scale data selection framework for language model training☆246Updated last year
- Learning to Compress Prompts with Gist Tokens - https://arxiv.org/abs/2304.08467☆284Updated 2 months ago
- ☆173Updated last year
- [EMNLP 2023] The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning☆240Updated last year
- This is the repo for the paper Shepherd -- A Critic for Language Model Generation☆219Updated last year
- Open Instruction Generalist is an assistant trained on massive synthetic instructions to perform many millions of tasks☆208Updated last year
- Scaling Data-Constrained Language Models☆334Updated 7 months ago
- ☆179Updated 2 years ago
- Reasoning with Language Model is Planning with World Model☆164Updated last year
- ☆120Updated 7 months ago
- ☆137Updated 5 months ago
- Reverse Instructions to generate instruction tuning data with corpus examples☆209Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆521Updated 3 months ago
- RLHF implementation details of OAI's 2019 codebase☆186Updated last year
- Code and data accompanying our paper on arXiv "Faithful Chain-of-Thought Reasoning".☆159Updated 11 months ago
- Multipack distributed sampler for fast padding-free training of LLMs☆188Updated 8 months ago
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆69Updated last year
- About The corresponding code from our paper " REFINER: Reasoning Feedback on Intermediate Representations" (EACL 2024). Do not hesitate t…☆70Updated last year
- ☆127Updated 5 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆150Updated last year
- A (somewhat) minimal library for finetuning language models with PPO on human feedback.☆85Updated 2 years ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆221Updated 6 months ago